Electronic device, and method for analyzing face information in electronic device

ABSTRACT

A method for analyzing face information in an electronic device is provided. The method includes detecting at least one face region from an image that is being captured by a camera module, zooming in the at least one detected face region, and analyzing the at least one detected and zoomed in face region according to at least one analysis item.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. § 119(a) of a Koreanpatent application filed on Nov. 4, 2014 in the Korean IntellectualProperty Office and assigned Serial number 10-2014-0152239, and of aKorean patent application filed on Jun. 29, 2015 in the KoreanIntellectual Property Office and assigned Serial number 10-2015-0092549,the entire disclosure of each of which is hereby incorporated byreference.

TECHNICAL FIELD

The present disclosure relates to an electronic device, and a method foranalyzing face information in the electronic device. More particularly,the present disclosure relates to a method for analyzing faceinformation in the electronic device, in which once face information(e.g., a face region) is identified, the identified region may be zoomedin or the focus may be automatically set on the region during capturing,without any user's control action.

BACKGROUND

A variety of electronic devices have been developed to provide variousfunctions. For example, an electronic device (e.g., a smart phone) hasbeen designed to provide not only a function of capturing images, butalso a function of recognizing the captured objects.

The electronic device may be provided with a display so that the usermay more effectively use or enjoy the various functions. For example,the recent smart phone may be provided with a display (e.g., a touchscreen), the front of which is sensitive to a touch.

Various applications (or Apps) may be installed and run in theelectronic device. In order to run and control the applications in theelectronic device, various input units (e.g., a touch screen, a button,a mouse, a keyboard, a sensor, and the like.) may be used.

In order to analyze an object (e.g., a face region) being captured, theelectronic device may obtain an image, the object in which is zoomed inor finely captured. On the other hand, in order to obtain the zoomed inor finely captured image, the user may determine or identify an objectto be captured and determine whether the focus is set on a detailedregion of each object, thereby enabling the shooting function (orcapturing function) of the electronic device.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect the presentdisclosure is to provide an electronic device and a method for analyzingface information in the electronic device, in which once faceinformation (e.g., a face region) is identified, the identified regionmay be zoomed in or the focus may be automatically set on the regionduring capturing, without any user's control action.

In accordance with an aspect of the present disclosure, a method foranalyzing face information in an electronic device is provided. Themethod includes detecting at least one face region from an image that isbeing captured by a camera module, zooming in the at least one detectedface region, and analyzing the zoomed in face region according to atleast one analysis item.

In accordance with another aspect of the present disclosure, anelectronic device is provided. The electronic device includes a cameramodule, a display configured to display an image that is being capturedby the camera module, and a controller configured to detect at least oneface region from the image, control the camera module to zoom in the atleast one detected face region, and analyze the at least one detectedand zoomed in face region according to at least one analysis item.

In accordance with another aspect of the present disclosure, a methodfor analyzing face information in an electronic device is provided. Themethod includes detecting at least one face region from at least onestored image and analyzing the at least one detected face regionaccording to at least one analysis item.

In accordance with another aspect of the present disclosure, anelectronic device is provided. The electronic device includes a cameramodule configured to capture an image and a controller configured todetect at least one face region from at least one image that is capturedby the camera module and stored, and analyze the at least one detectedface region according to at least one analysis item.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a block diagram illustrating a configuration of an electronicdevice according to various embodiments of the present disclosure;

FIGS. 2, 3, and 4 are flowcharts illustrating an operation of analyzingskin information in an electronic device according to variousembodiments of the present disclosure;

FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H illustrate a face region and asituation in which the face region is partially zoomed in or finelycaptured according to various embodiments of the present disclosure;

FIG. 6 illustrates face analysis items according to various embodimentsof the present disclosure;

FIGS. 7, 8, 9, 10, and 11 illustrate an operation of analyzing faceanalysis items according to various embodiments of the presentdisclosure;

FIG. 12 illustrates a shooting operation for a face analysis accordingto various embodiments of the present disclosure;

FIGS. 13A, 13B, and 13C illustrate a screen showing results of a faceanalysis according to various embodiments of the present disclosure;

FIGS. 14, 15, 16, 17, and 18 illustrate a screen showing results of askin analysis according to various embodiments of the presentdisclosure;

FIG. 19 illustrates a network environment according to variousembodiments of the present disclosure;

FIGS. 20A, 20B, and 20C illustrate a situation in which an electronicdevice analyzes a face according to various embodiments of the presentdisclosure;

FIG. 21 is a flowchart illustrating an operation of analyzing skininformation in an electronic device according to various embodiments ofthe present disclosure;

FIGS. 22A and 22B illustrate a shooting operation for a face analysisaccording to various embodiments of the present disclosure;

FIGS. 23A and 23B illustrate a shooting operation for a face analysisaccording to various embodiments of the present disclosure;

FIG. 24 illustrates a shooting operation for a face analysis accordingto various embodiments of the present disclosure;

FIG. 25 is a block diagram illustrating a configuration of an electronicdevice according to various embodiments of the present disclosure;

FIG. 26 illustrates a screen of an application for analyzing faceinformation based on a stored image according to various embodiments ofthe present disclosure;

FIGS. 27, 28, 29, 30, 31, 32, 33, 34, and 35 illustrate a screen showingthe face analysis results according to various embodiments of thepresent disclosure;

FIG. 36 illustrates an application screen showing a history of faceinformation analyzed based on a stored image according to variousembodiments of the present disclosure;

FIGS. 37, 38, 39, 40, 41, 42, 43, 44, and 45 illustrate a screen showingthe history of analyzed face information according to variousembodiments of the present disclosure;

FIG. 46 illustrates a shooting operation for a face analysis accordingto various embodiments of the present disclosure; and

FIGS. 47A and 47B illustrate a screen showing results of skin analysisaccording to various embodiments of the present disclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

By the term “substantially” it is meant that the recited characteristic,parameter, or value need not be achieved exactly, but that deviations orvariations, including for example, tolerances, measurement error,measurement accuracy limitations and other factors known to those ofskill in the art, may occur in amounts that do not preclude the effectthe characteristic was intended to provide.

The terms “comprise” and/or “comprising” as herein used specify thepresence of disclosed functions, operations, or components, but do notpreclude the presence or addition of one or more other functions,operations, or components. It will be further understood that the terms“comprise” and/or “have,” when used in this specification, specify thepresence of stated features, integers, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, operations, elements, components, and/orgroups thereof.

As used herein, the term “A or B” or “at least one of A and/or B”includes any and all combinations of one or more of the associatedlisted items. For examples, “A or B” or “at least one of A or/and B”each may include A, or include B, or include both A and B.

Ordinal numbers as herein used, such as “first”, “second”, and the like,may modify various components of various embodiments of the presentdisclosure, but do not limit those components. For example, these termsdo not limit the order and/or importance of the components. These termsare only used to distinguish one component from another. For example, afirst user device and a second user device are different user devicesfrom each other. For example, according to various embodiments of thepresent disclosure, a first component may be denoted a second component,and vice versa without departing from the scope of the presentdisclosure.

When a component is “connected to” or “coupled to” another component,the component may be directly connected or coupled to the othercomponent, or other component(s) may intervene therebetween. Incontrast, when a component is “directly connected to” or “directlycoupled to” another component, no other intervening components mayintervene therebetween.

The terms as used herein are provided merely to describe someembodiments thereof, but not to limit the present disclosure.

Unless otherwise defined, all terms including technical and scientificterms used herein have the same meaning as commonly understood by one ofordinary skill in the art to which the various embodiments of thepresent disclosure belong. It will be further understood that terms,such as those defined in commonly used dictionaries, should beinterpreted as having a meaning that is consistent with their meaning inthe context of the relevant art and will not be interpreted in anidealized or overly formal sense unless expressly so defined herein.

An electronic device according to various embodiments of the presentdisclosure may be a camera module. For example, the electronic devicemay include at least one of a smart phone, a tablet personal computer(PC), a mobile phone, a video phone, an e-book reader, a desktop PC, alaptop PC, a netbook computer, a personal digital assistant (PDA), aportable multimedia player (PMP), a Moving Picture Experts Group phase 1or phase 2 (MPEG-1 or MPEG-2) audio layer 3 (MP3) player, a mobilemedical device, a camera, or a wearable device (e.g., ahead-mounted-device (HMD), such as electronic glasses, electronicclothing, electronic bracelet, electronic necklace, electronicapplication accessory (or appcessory), electronic tattoo, a smart watch,and the like).

In various embodiments of the present disclosure, the electronic devicemay be a smart home appliance with a camera module. The smart homeappliance may include at least one of, for example, a television (TV), adigital video disc (DVD) player, an audio player, a refrigerator, an airconditioner, a cleaner, an oven, a microwave oven, a washer, an airpurifier, a set-top box, a TV box (e.g., Samsung HomeSync™, Apple TV™,or Google TV™), game consoles, an electronic dictionary, an electronickey, a camcorder, or an electronic photo frame.

In various embodiments of the present disclosure, the electronic devicemay include a camera module, and may further include at least one ofvarious medical devices (e.g., magnetic resonance angiography (MRA),magnetic resonance imaging (MRI), computed tomography (CT), a camcorder,a ultrasonic device, and the like), a navigation device, a globalpositioning system (GPS) receiver, an event data recorder (EDR), aflight data recorder (FDR), an automotive infotainment device, a marineelectronic device (e.g., a marine navigation device, a gyro compass, andthe like), avionics, a security device, a car head unit, an industrialor household robot, an automatic teller's machine (ATM) for banks, pointof sales (POS) for shops, and the like.

In various embodiments of the present disclosure, the electronic devicemay include at least one of a part of the furniture orbuilding/structure, an electronic board, an electronic signaturereceiving device, a projector or various meters (e.g., a water meter, anelectricity meter, a gas meter, a radio wave meter, and the like), eachof which includes a camera module. The electronic device according tovarious embodiments of the present disclosure may be one or acombination of the above-described devices. Further, the electronicdevice according to various embodiments of the present disclosure may bea flexible device. It will be apparent to those skilled in the art thatthe electronic device according to various embodiments of the presentdisclosure is not limited to the above-described devices.

In accordance with various embodiments of the present disclosure, theface information that can be analyzed by the electronic device mayinclude skin information of face regions, such as eyes, nose, brow,cheek, and the like.

In accordance with various embodiments of the present disclosure, theelectronic device may analyze skin information according to at least oneanalysis item. For example, items for analyzing the face information mayinclude items for measuring a variety of skin conditions, such as pores,acne, pigmentation, skin tone, dark circles, wrinkles, and the like.

In accordance with various embodiments of the present disclosure, anoperation in which the electronic device performs fine shooting mayinclude an operation in which in order to finely capture any one regionin a specific image, the focus is set on the region and the region iszoomed in, during the capturing.

The electronic device according to various embodiments of the presentdisclosure will be described below with reference to the accompanyingdrawings. As used herein, the term ‘user’ may refer to a person who usesthe electronic device, or a device (e.g., an intelligent electronicdevice) that uses the electronic device.

FIG. 1 is a block diagram illustrating a configuration of an electronicdevice according to various embodiments of the present disclosure.

Referring to FIG. 1, an electronic device 100 may include at least oneof a controller 110, a camera module 120, an input unit 130, a display140, or a storage 150.

The controller 110 may include at least one of an item setting unit 111,a shooting controller 112, an image analyzer 113, a region selector 114,or an analysis result generator 115, and may control the overalloperation of the electronic device 100.

The item setting unit 111 may identify a specific face region in acaptured image, and select at least one item for analyzing the skinconditions of the identified face region. For example, if a regionaround the eyes is identified in the captured image, the item settingunit 111 may set wrinkles, dark circles, and the like, as an item foranalyzing the skin conditions of the region around the eyes. As anotherexample, if a cheek region is identified in the captured image, the itemsetting unit 111 may set pigmentation, dots, freckles, skin tone, andthe like, as an item for analyzing the skin conditions of the cheekregion.

Upon identifying a specific face region in the shooting mode, theshooting controller 112 may control the camera module 120 so that theidentified face region may be zoomed in or finely captured. For example,the shooting controller 112 may control the camera module 120 so as toset the focus on or zoom in at least one region identified as a faceregion during the capturing, in the captured image identified throughthe camera module 120.

The image analyzer 113 may select at least one item for analyzing aspecific face region in the image, and analyze the face region accordingto the selected item. For example, the image analyzer 113 may analyzethe region around the eyes, which is identified in the captured image,according to the selected item (e.g., wrinkles or dark circles). Forexample, the image analyzer 113 may analyze the depth or the number ofwrinkles or the width or color of dark circles in the identified regionaround the eyes.

The region selector 114 may determine whether a face region isidentified in a specific image. According to various embodiments of thepresent disclosure, if a specific face region is identified, the regionselector 114 may control the camera module 120 so as to set the focus onor zoom in the face region during the capturing.

The analysis result generator 115 may determine a result of the faceinformation analyzed by the image analyzer 113, generate a screenincluding the determined result, and display the generated screen.

According to various embodiments of the present disclosure, the analysisresult generator 115 may represent the analysis item or analysis resultfor each face region in various ways, to generate a screen of theanalyzed face information. For example, the analysis result generator115 may generate a screen of the face information so that each analysisitem may be displayed in a different color (for example, the acne may bedisplayed in red and the pigmentation may be displayed in blue).Further, by determining the previous analysis result, the analysisresult generator 115 may display the improved face region in green orblue and the worsened face region in red, to generate a screen of theface information.

According to various embodiments of the present disclosure, if a regioncorresponding to a specific face region, or a region that isdistinguished in a different color according to the analysis item oranalysis result is selected from the captured image, the analysis resultgenerator 115 may provide an image obtained by zooming in or analyzingthe selected face region. For example, the analysis result generator 115may control the display 140 so as to display the generated image.

The camera module 120 may capture an image. According to variousembodiments of the present disclosure, the camera module 120 may becontrolled by the controller 110 so as to set the focus on and zoom in aregion identified as a specific face region, during the capturing.

The display 140 may display an image that is being captured by thecamera module 120.

According to various embodiments of the present disclosure, if aspecific region is selected from the displayed image, the display 140may display an image obtained by zooming in or finely capturing theregion. For example, as the electronic device 100 selects a specificregion, the zoomed in image may be an image obtained by zooming in andcapturing the selected region. As the electronic device 100 selects aspecific region, the zoomed in image may be an image, in which the focusis set on the selected region and the selected region is zoomed in,during the capturing.

The storage 150 may include skin analysis information 151 or useridentification information 152. The skin analysis information 151 mayinclude skin analysis information of a specific face region according tothe analysis item.

The skin analysis information 151 may include information obtained byanalyzing the skin conditions of a specific region for each item. Forexample, the skin analysis information 151 may include informationobtained by determining the presence/absence of pigmentation, skin tone,dots or acne in a specific face region, the previously analyzedinformation for each item, or history information that shows the skinanalysis result for each face region in a time sequence.

The user identification information 152 may include face information fora specific user. For example, the image analyzer 113 may compare an‘eye’ region identified in the captured image with the previously stored‘eye’ image of another user, using the user identification information152. As for user identification information 152, based on the comparisonresult in the image analyzer 113, the analysis result for the faceregion identified in the captured image may be stored in the faceinformation about the user including the same face region.

For example, an electronic device according to various embodiments ofthe present disclosure may include a camera module, a display configuredto display an image that is being captured by the camera module, and acontroller configured to detect at least one face region from the image,control the camera module to zoom in the at least one detected faceregion, and analyze the zoomed in face region according to at least oneanalysis item.

The at least one face region according to various embodiments of thepresent disclosure may include a region around at least one of eyes,nose, cheeks, mouth or brow.

The at least one analysis item according to various embodiments of thepresent disclosure may include at least one of wrinkles, acne,pigmentation, skin tone, dark circles or pores.

The controller according to various embodiments of the presentdisclosure may analyze at least one of thickness, size, number, width orcolor for each analysis item in the zoomed in face region.

Upon detecting an input of a gesture for a specific region in the image,the controller according to various embodiments of the presentdisclosure may control the display to display an image obtained byzooming in a region where the gesture is detected.

The controller according to various embodiments of the presentdisclosure may detect a face region for at least one predeterminedanalysis item from the image, and analyze the detected face regionaccording to the predetermined analysis item.

Upon detecting the at least one face region, the controller according tovarious embodiments of the present disclosure may control the display todisplay a screen for the zoomed in face region.

The controller according to various embodiments of the presentdisclosure may control the camera module to finely capture the at leastone detected face region upon detecting a predetermined action.

The predetermined action according to various embodiments of the presentdisclosure may include any one of an action of running an application inwhich the camera module is enabled, an action of enabling the electronicdevice 100 in a locked state, or an action of positioning the electronicdevice 100 at a specific angle or in a specific direction.

The controller according to various embodiments of the presentdisclosure may determine a pre-stored analysis result for a specificface region or analysis item, compare the determined pre-stored analysisresult with a result of the analysis, and control the display to displaya screen including a result of the comparison.

FIG. 2 is a flowchart illustrating an operation of analyzing skininformation in an electronic device according to various embodiments ofthe present disclosure.

Referring to FIG. 2, in operation 210, the electronic device may detecta face region from a captured image.

In operation 220, the electronic device may select an analysis item fromthe captured face region.

In operation 230, the electronic device may finely capture the selecteditem. For example, the electronic device may set the focus on and zoomin the selected item during the capturing.

In operation 240, the electronic device may analyze the zoomed in image.According to various embodiments of the present disclosure, theelectronic device may compare the zoomed in image with the previouslystored result value. For example, the electronic device may compare thezoomed in image with the previously stored result value to analyze theface region corresponding to the zoomed in image.

According to various embodiments of the present disclosure, if the usercaptures an image including a face region, the captured output image mayinclude an image obtained by zooming in or finely capturing each faceregion included in the captured image, or an image including a result ofanalyzing the zoomed in or finely captured image. For example, bycapturing a face region, the user may obtain an image obtained byzooming in or finely capturing each face region and a result ofanalyzing the zoomed in or finely captured image, without taking anyadditional action for face analysis.

At least one of operations 210 to 240 shown in FIG. 2 may be omitted, orat least one other operation may be added in between operations 210 to240. Further, operations 210 to 240 in FIG. 2 may be performed in thedepicted order, or at least one of operations 210 to 240 may be changedin execution order.

For example, a method for analyzing face information in an electronicdevice according to various embodiments of the present disclosure mayinclude detecting at least one face region from an image that is beingcaptured by a camera module, zooming in the at least one detected faceregion, and analyzing the zoomed in face region according to at leastone analysis item. The at least one face region may include a regionaround at least one of eyes, nose, cheeks, mouth or brow. The at leastone analysis item may include at least one of wrinkles, acne,pigmentation, skin tone, dark circles or pores.

The analyzing according to various embodiments of the present disclosuremay include analyzing at least one of thickness, size, number, width orcolor for each analysis item in the zoomed in face region.

The method according to various embodiments of the present disclosuremay further include, upon detecting an input of a gesture for a specificregion in the image, displaying an image obtained by zooming in a regionwhere the gesture is detected.

The method according to various embodiments of the present disclosuremay further include detecting a face region for at least onepredetermined analysis item from the image, and analyzing the detectedface region according to the predetermined analysis item.

The method according to various embodiments of the present disclosuremay further include, upon detecting the at least one face region,displaying a screen obtained by zooming in the detected face region.

The method according to various embodiments of the present disclosuremay further include zooming in the at least one detected face regionupon detecting a predetermined action. The predetermined action mayinclude any one of an action of running an application in which thecamera module is enabled, an action of enabling the electronic device ina locked state, and an action of positioning the electronic device at aspecific angle or in a specific direction.

The method according to various embodiments of the present disclosuremay further include determining a pre-stored analysis result for aspecific face region or analysis item, and comparing the determinedpre-stored analysis result with a result of the analysis, and displayinga result of the comparison.

FIG. 3 is a flowchart illustrating an operation of analyzing skininformation in an electronic device according to various embodiments ofthe present disclosure.

Referring to FIG. 3, in operation 310, the electronic device may detecta face region from a captured image.

In operation 320, the electronic device may identify at least onefocused region in the captured face region.

In operation 330, the electronic device may zoom in or finely capturethe at least one focused region. For example, as the focused region iszoomed in or finely captured, the output image may be an image obtainedby setting the focus on and/or zooming in a specific region during thecapturing.

Although the electronic device has performed an operation of identifyingat least one focused region in operation 320 according to variousembodiments of the present disclosure, the electronic device may zoom inor finely capture a detected face region, upon detecting the face regionfrom the image that is captured in operation 310. In this case,operation 320 may be omitted.

At least one of operations 310 to 330 shown in FIG. 3 may be omitted, orat least one other operation may be added in between operations 310 to330. Further, operations 310 to 330 in FIG. 3 may be performed in thedepicted order, or at least one of operations 310 to 330 may be changedin execution order.

FIG. 4 is a flowchart illustrating an operation of analyzing skininformation in an electronic device according to various embodiments ofthe present disclosure.

Referring to FIG. 4, in operation 410, the electronic device maydetermine whether any application is run, in the non-shooting mode.

In operation 420, the electronic device may determine whether apredetermined user input is detected.

If it is determined that the predetermined user input is not detected,the electronic device may perform again operation 410.

If it is determined that the predetermined user input is detected, theelectronic device may control the camera module to operate in thebackground, in operation 430.

In operation 440, the electronic device may determine whether a faceregion is identified in the captured image.

If it is determined that the face region is not identified, theelectronic device may perform again operation 410.

If it is determined that the face region is identified, the electronicdevice may select at least one analysis item for the identified image inoperation 450. For example, the least one analysis item in the image mayinclude at least one of the items for measuring various skin conditions,such as pores, acne, pigmentation, skin tone, dark circles, wrinkles,and the like.

In operation 460, the electronic device may control the camera module soas to zoom in or set focus on the selected item.

In operation 470, the electronic device may analyze the zoomed in image.

At least one of operations 410 to 470 shown in FIG. 4 may be omitted, orat least one other operation may be added in between operations 410 to470. Further, operations 410 to 470 in FIG. 4 may be performed in thedepicted order, or at least one of operations 410 to 470 may be changedin execution order.

FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H illustrate a face region and asituation in which the face region is partially zoomed in or finelycaptured according to various embodiments of the present disclosure.

Referring to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H, according tovarious embodiments of the present disclosure, it is assumed that theelectronic device is capturing or shooting the entire face. Theelectronic device may identify at least one face region in an image 500that is being captured.

Referring to FIG. 5A, the electronic device may identify at least one ofa brow 501, a right eye 502, a left eye 506, a nose 503, a mouth edge504, a cheek 505 or a face 507 in the image 500 being captured.

According to various embodiments of the present disclosure, uponidentifying at least one face region in the image 500 being captured,the electronic device may zoom in the region to capture an imageobtained by partially zooming in or finely capturing the region.

Referring to FIG. 5B, upon identifying the brow 501 in the image 500being capture, the electronic device may zoom in a region of the brow501 to partially zoom in or finely capture the region. The electronicdevice may obtain skin analysis information that is based on at leastone analysis item, from the captured image obtained by partially zoomingin the region of the brow 501. For example, the skin analysisinformation may include information about wrinkles 501 a in the regionof the brow 501.

Referring to FIG. 5C, upon identifying the right eye 502 in the image500 being captured, the electronic device may zoom in a region of theright eye 502 to partially zoom in or finely capture the region. Theelectronic device may obtain skin analysis information that is based onat least one analysis item, from the captured image obtained bypartially zooming in the region of the right eye 502. For example, theskin analysis information may include information about wrinkles 502 ain the region of the right eye 502.

Referring to FIG. 5D, upon identifying the nose 503 in the image 500being captured, the electronic device may zoom in a region of the nose503 to partially zoom in or finely capture the region. The electronicdevice may obtain skin analysis information that is based on at leastone analysis item, from the captured image obtained by partially zoomingin the region of the nose 503. For example, the skin analysisinformation may include information about pores 503 a in the region ofthe nose 503.

Referring to FIG. 5E, upon identifying the mouth edge 504 in the image500 being captured, the electronic device may zoom in a region of themouth edge 504 to partially zoom in or finely capture the region. Theelectronic device may obtain skin analysis information that is based onat least one analysis item, from the captured image obtained bypartially zooming in the region of the mouth edge 504. For example, theskin analysis information may include information about pigmentation 504a in the region of the mouth edge 504.

Referring to FIG. 5F, upon identifying the cheek 505 in the image 500being captured, the electronic device may zoom in a region of the cheek505 to partially zoom in or finely capture the region. The electronicdevice may obtain skin analysis information that is based on at leastone analysis item, from the captured image obtained by partially zoomingin the region of the cheek 505. For example, the skin analysisinformation may include information about acne 505 a in the region ofthe cheek 505.

Referring to FIG. 5G, upon identifying the left eye 506 in the image 500being captured, the electronic device may zoom in a region of the lefteye 506 to partially zoom in or finely capture the region. Theelectronic device may obtain skin analysis information that is based onat least one analysis item, from the captured image obtained bypartially zooming in the region of the left eye 506. For example, theskin analysis information may include information about dark circles 506a in the region of the left eye 506.

Referring to FIG. 5H, upon identifying the face 507 in the image 500being captured, the electronic device may zoom in a region of the face507 to partially zoom in or finely capture the region. The electronicdevice may obtain skin analysis information that is based on at leastone analysis item, from the captured image obtained by partially zoomingin the region of the face 507. For example, the skin analysisinformation may include information about skin tone 507 a in the regionof the face 507.

FIG. 6 illustrates face analysis items according to various embodimentsof the present disclosure.

Referring to FIG. 6, the electronic device has captured an image 600including at least one face region, and may identify at least oneanalysis item in the captured image 600. For example, the electronicdevice may identify acne 601, wrinkles 602 or pigmentation 603, as ananalysis item.

FIG. 7 illustrates an operation of analyzing a face analysis itemaccording to various embodiments of the present disclosure.

Referring to FIG. 7, the electronic device may analyze pigmentation 711among the analysis items in a captured image 710.

According to various embodiments of the present disclosure, theelectronic device may generate an image 720 obtained by inverting thecolor of the pigmented part in the captured image. The electronic devicemay determine the color-inversed region in the image 720, thereby toidentify at least one pigmented part 721. For example, the electronicdevice may determine whether the pigmentation has been improved orworsened than before, depending on the number of pigmented parts.

FIG. 8 illustrates an operation of analyzing a face analysis itemaccording to various embodiments of the present disclosure.

Referring to FIG. 8, the electronic device may analyze acne 811 amongthe analysis items in a captured image 810.

According to various embodiments of the present disclosure, theelectronic device may generate an image 820 obtained by inverting thecolor of the part where acne is identified in the captured image. Forexample, the electronic device may determine the color-inversed regionin the image 820, thereby to identify at least one acne spots 821. Forexample, the electronic device may determine whether the acne hasincreased or decreased than before, depending on the number of acnespots.

FIG. 9 illustrates an operation of analyzing a face analysis itemaccording to various embodiments of the present disclosure.

Referring to FIG. 9, the electronic device may analyze pores 911 amongthe analysis items in a captured image 910.

According to various embodiments of the present disclosure, theelectronic device may generate an image 920 obtained by darkening thecolor of the part where pores are identified in the captured image. Forexample, the electronic device may determine the color-darkened region921 in the image 920, thereby to identify at least one pore. Forexample, the electronic device may determine whether the pores haveincreased or decreased than before, depending on the number of pores.

FIG. 10 illustrates an operation of analyzing a face analysis itemaccording to various embodiments of the present disclosure.

Referring to FIG. 10, the electronic device may analyze wrinkles 1001among the analysis items in a captured image 1000.

According to various embodiments of the present disclosure, theelectronic device may represent wrinkle lines 1001 in a region wherewrinkles are identified in the captured image 1000. For example, theelectronic device may determine the presence/absence of wrinkles bydetermining at least one wrinkle line 1001 in the captured image 1000.

According to various embodiments of the present disclosure, theelectronic device may determine the thickness or the number of at leastone wrinkle line represented in the captured image. For example, theelectronic device may determine whether the wrinkles have been deeperthan before, depending on the thickness of the at least one wrinkleline, and may determine whether wrinkles have increased or decreasedthan before, depending on the number of wrinkle lines.

FIG. 11 illustrates an operation of analyzing a face analysis itemaccording to various embodiments of the present disclosure.

Referring to FIG. 11, the electronic device may analyze skin tone 1101among the analysis items in a captured image 1100.

According to various embodiments of the present disclosure, theelectronic device may set a part of the skin as a skin tone analysisregion 1101 in the captured image 1100. For example, by determining atleast one skin tone analysis region 1101 in the captured image 1100, theelectronic device may compare a value obtained by measuring the at leastone skin tone analysis region 1101 with the previously measured skintone value, or may obtain a measurement value for the skin tone analysisregion.

According to various embodiments of the present disclosure, theelectronic device may analyze the skin tone analysis region 1101 in thecaptured image 1100. For example, the electronic device may measure thecolor, contrast, brightness, color temperature, and the like, of theskin tone analysis region, thereby to determine whether the measuredskin tone looks duller or brighter than the previously measured skintone.

FIG. 12 illustrates a shooting operation for a face analysis accordingto various embodiments of the present disclosure.

Referring to FIG. 12, it is assumed that the electronic device iscapturing or shooting a face region for face analysis.

According to various embodiments of the present disclosure, theelectronic device may determine the characteristics (e.g., resolution,image size, white balance, and the like) of the image presently beingcaptured. The electronic device may compare the characteristics of theimage presently being captured with the characteristics of thepreviously captured image. For example, if the characteristics (e.g.,white balance) of the image presently being captured are not similar tothe characteristics of the previously captured image, the electronicdevice may synchronize the characteristics of the image presently beingcaptured with the characteristics of the previously captured image.

Referring to FIG. 12, the electronic device may display a screen 1210indicating that the electronic device is matching the white balance ofthe image presently being captured with the white balance of thepreviously captured image. After synchronizing the characteristics ofthe image presently being captured with the characteristics of thepreviously captured image, the electronic device may display a screen1220 indicating that shooting is possible because the synchronization ofthe white balance is completed.

According to various embodiments of the present disclosure, the user maydetermine on the screen 1220 that the current shooting situation in theelectronic device is set to be similar to the previous shootingsituation of the image for face analysis. Accordingly, it is possible toprevent the situation in which the analysis result for the faceinformation may be different due to the causes, such as lighting,indoor/outdoor environment, weather, and the like, despite the same skinconditions.

FIGS. 13A, 13B, and 13C illustrate a screen showing results of a faceanalysis according to various embodiments of the present disclosure.

Referring to FIGS. 13A, 13B, and 13C, according to various embodimentsof the present disclosure, upon identifying at least one face region ina captured image, the electronic device may zoom in or finely capturethe at least one face region. For example, the electronic device maygenerate an analysis result screen 1300 including the zoomed in orfinely captured region in the face region corresponding to the capturedimage. For example, the analysis result screen 1300 may include a zoomedin or finely captured region for each of an eye 1310, a nose 1320 and acheek 1330, which are identified as at least one face region.

Referring to FIG. 13A, the user may select the eye 1310 on the analysisresult screen 1300. According to various embodiments of the presentdisclosure, the electronic device may output an image obtained byzooming in or finely capturing the eye 1310. For example, in the imageobtained by zooming in or finely capturing the eye 1310, a lineindicating at least one wrinkle 1311 around the eye 1310 may bedisplayed.

Referring to FIG. 13B, the user may select the nose 1320 on the analysisresult screen 1300. According to various embodiments of the presentdisclosure, the electronic device may output an image obtained byzooming in or finely capturing the nose 1320. For example, in the imageobtained by zooming in or finely capturing the nose 1320, at least oneacne spot 1321 around the nose 1320 may be displayed.

Referring to FIG. 13C, the user may select the cheek 1330 on theanalysis result screen 1300. According to various embodiments of thepresent disclosure, the electronic device may output an image obtainedby zooming in or finely capturing the cheek 1330. For example, in theimage obtained by zooming in or finely capturing the cheek 1330, thecolor of at least one pigmented part 1331 around the cheek 1330 may bedisplayed in a highlighted manner.

FIG. 14 illustrates a screen showing results of a skin analysisaccording to various embodiments of the present disclosure.

Referring to FIG. 14, an analysis result screen 1410 may include aselection item of View Skin Analysis History 1411 for showing thehistory of skin analysis results for each analysis item.

According to various embodiments of the present disclosure, if the ViewSkin Analysis History 1411 is selected, the electronic device may switchto a skin analysis history screen 1420.

The skin analysis history screen 1420 according to various embodimentsof the present disclosure may show the history of skin analysis resultsfor each of skin analysis items (e.g., skin tone, acne, wrinkles,pigmentation, pores, and the like) measured in a specific period (e.g.,from June to August).

For example, a skin tone measurement result 1421 may show that themeasured skin tone is brighter than before. An acne measurement result1422 may show that the measured acne has increased than before. Awrinkle measurement result 1423 may show that the number of measuredwrinkles is similar to the number of previous wrinkles. A pigmentationmeasurement result 1424 may show that the color of the pigmented partsis lighter than before. A pore measurement result 1425 may show that thenumber of pores has increased than before.

FIG. 15 illustrates a screen showing results of a skin analysisaccording to various embodiments of the present disclosure.

Referring to FIG. 15, according to various embodiments of the presentdisclosure, the electronic device may analyze a specific face region,and recommend ways to improve the face region depending on the analysisresults.

Upon identifying a region around the eyes in a captured image 1510, theelectronic device may analyze the skin conditions of the region aroundthe eyes, and display the analysis results. For example, as a result ofthe analysis, the electronic device may determine that new wrinkles areidentified or found around the eyes of a specific user or the number ofwrinkles has increased than before.

According to various embodiments of the present disclosure, theelectronic device may provide a skin care recommendation screen 1520including ways to improve wrinkles. For example, if the user selectswrinkle marks 1511 in the captured image 1510, the electronic device mayswitch from the screen showing the captured image 1510 to the skin carerecommendation screen 1520.

The skin care recommendation screen 1520 according to variousembodiments of the present disclosure may include cosmetics 1521 whichare good for wrinkles, a run button (or execution button) 1522 forsearching for more eye creams, or a run button 1523 for recommendingmassage methods good for wrinkles around eyes. For example, thecosmetics 1521 which are good for wrinkles may include ** eye cream 1521a, ## cream 1521 b, or oo eye cream 1521 c, and may further include arun button by which the user can rate each cosmetic, or order specificcosmetic.

FIG. 16 illustrates a screen showing results of a skin analysisaccording to various embodiments of the present disclosure.

Referring to FIG. 16, according to various embodiments of the presentdisclosure, the electronic device may analyze a specific face region,and recommend ways to improve the face region depending on the analysisresults. For example, as a result of the analysis, the electronic devicemay identify the part where the skin tones are changed around the cheeksof a specific user.

Upon identifying a region around the cheeks in a captured image 1610,the electronic device may display a skin tone analysis region 1611, inwhich skin tones for a specific region of the cheeks are analyzed.

According to various embodiments of the present disclosure, theelectronic device may provide a skin care recommendation screen 1620including ways to improve skin tones. For example, if the user selectsthe skin tone analysis region 1611 in the captured image 1610, theelectronic device may switch from the screen showing the captured image1610 to the skin care recommendation screen 1620.

The skin care recommendation screen 1620 according to variousembodiments of the present disclosure may include mask packs 1621 whichare good for improvement of skin tones, or a run button 1622 forsearching for more mask packs. For example, the mask packs 1621 whichare good for improvement of skin tones may include ** mask pack 1621 aor

mask pack 1621 b, and may further include a run button by which the usercan go to a screen showing the characteristics of each mask pack, ororder a specific mask pack.

FIG. 17 illustrates a screen showing results of a skin analysisaccording to various embodiments of the present disclosure.

Referring to FIG. 17, according to various embodiments of the presentdisclosure, the electronic device may analyze a specific face region,and provide an advertising screen for a product capable of improving theface region depending on the analysis results.

Upon identifying a region around the cheeks or at least one acne spot inthe region around the cheeks in a captured image 1710, the electronicdevice may display the identified acne 1711 in a highlighted manner.

According to various embodiments of the present disclosure, theelectronic device may provide an advertising screen 1720 for advertisinga product capable of improving the acne. For example, if the userselects the acne 1711 shown in the captured image 1710, the electronicdevice may switch from the screen showing the captured image 1710 to theadvertising screen 1720.

The advertising screen 1720 according to various embodiments of thepresent disclosure may include an advertisement for acne treatment, or a‘More’ run button 1721 for switching to a screen for description of theacne treatment.

FIG. 18 illustrates a screen showing results of a skin analysisaccording to various embodiments of the present disclosure.

Referring to FIG. 18, according to various embodiments of the presentdisclosure, the electronic device may analyze a specific face region,and recommend ways to improve the face region depending on the analysisresults.

Upon identifying the nose in a captured image 1810, the electronicdevice may display a pore analysis region 1811, in which the number ofpores in the nose is analyzed.

According to various embodiments of the present disclosure, theelectronic device may provide a skin care recommendation screen 1820including ways to reduce the number of pores. For example, if the userselects the pore analysis region 1811 in the captured image 1810, theelectronic device may switch from the screen showing the captured image1810 to the skin care recommendation screen 1820.

The skin care recommendation screen 1820 according to variousembodiments of the present disclosure may include information 1821 aboutthe dermatology clinics known for pore treatment, or an advertisement1822 for a specific dermatology clinic. For example, the advertisement1822 for a specific dermatology clinic may include a screen showingmedical departments of the dermatology clinic, or a shortcut run buttonfor switching to an information screen of the dermatology clinic.

FIG. 19 illustrates a network environment according to variousembodiments of the present disclosure.

Referring to FIG. 19, a network environment 1900 may include at leastone electronic device 1901 or 1904, or a server 1906. The at least oneelectronic device 1901 or 1904 may be connected to the server 1906 overa network 1962.

The electronic device 1901 may include a bus 1910, a processor 1920, amemory 1930, an input/output (I/O) interface 1940, a display 1950, acommunication interface 1960, and a camera module 1970.

The bus 1910 may be a circuit that connects the above-describedcomponents to each other, and delivers communication information (e.g.,a control message) between the above-described components.

The processor 1920 may, for example, receive a command from theabove-described other components (e.g., the memory 1930, the I/Ointerface 1940, the display 1950, the communication unit 1960, thecamera module 1970, and the like) through the bus 1910, decrypt thereceived command, and perform the operation or data processing based onthe decrypted command.

The processor 1920 may control the overall operation of the electronicdevice 1901. According to various embodiments of the present disclosure,the processor 1920 may include at least one controller (e.g., thecontroller 110).

The memory 1930 may store the command or data that is received from orgenerated by the processor 1920 or other components (e.g., the I/Ointerface 1940, the display 1950, the communication interface 1960, thecamera module 1970, and the like). The memory 1930 may includeprogramming modules, such as, for example, a kernel 1931, a middleware1932, an application programming interface (API) 1933 or anapplication(s) 1934. Each of the above-described programming modules maybe configured by software, firmware, hardware or a combination thereof.

The kernel 1931 may control or manage the system resources (e.g., thebus 1910, the processor 1920, the memory 1930, and the like) used toexecute the operation or function implemented in the other programmingmodules (e.g., the middleware 1932, the API 1933 or the application1934). Further, the kernel 1931 may provide an interface by which themiddleware 1932, the API 1933 or the application 1934 may accessindividual components of the electronic device 1901, and control ormanage the individual components.

The middleware 1932 may perform an intermediary role so that the API1933 or the application 1934 may communicate with the kernel 1931thereby to exchange data with each other. Further, in response to workrequests received from the application 1934, the middleware 1932 may,for example, perform control (e.g., scheduling or load balancing) forthe work requests by using a method of assigning a priority capable ofusing the system resources (e.g., the bus 1910, the processor 1920, thememory 1930, and the like) of the electronic device 1901 to at least oneof the application(s) 1934.

The API 1933 may include at least one interface or function (e.g., acommand) for, for example, file control, window control, imageprocessing, character control, and the like, as an interface by whichthe application 1934 controls a function provided in the kernel 1931 orthe middleware 1932.

According to various embodiments of the present disclosure, theapplication 1934 may include a short message service (SMS)/multimediamessaging service (MMS) application, an E-mail application, a calendarapplication, an alarm application, a healthcare application (e.g., anapplication for measuring the amount of exercise or the blood glucose),or an environmental information application (e.g., an application forproviding information about the pressure, humidity, temperature, and thelike). Additionally or alternatively, the application 1934 may be anapplication related to information exchange between the electronicdevice 1901 and an external electronic device (e.g., the electronicdevice 1904). The application related to information exchange mayinclude, for example, a notification relay application for relayingspecific information to the external electronic device, or a devicemanagement application for managing the external electronic device.

For example, the notification relay application may include a functionof delivering the notification information generated in otherapplications (e.g., the SMS/MMS application, the E-mail application, thehealthcare application, the environmental information application, andthe like) of the electronic device 1901 to the external electronicdevice (e.g., the electronic device 1904). Additionally oralternatively, the notification relay application may, for example,receive notification information from the external electronic device(e.g., the electronic device 1904), and provide the receivednotification information to the user. The device management applicationmay, for example, manage (e.g., install, delete or update) a function(e.g., a function of controlling the turn-on/off of the externalelectronic device itself (or some of its parts), or the brightness (orresolution) of the display) for at least a part of the externalelectronic device (e.g., the electronic device 1904) communicating withthe electronic device 1901, manage an application operating in theexternal electronic device, or manage the service (e.g., a call serviceor a messaging service) provided in the external electronic device.

According to various embodiments of the present disclosure, theapplication 1934 may include an application that is specified dependingon the properties (e.g., the type of the electronic device) of theexternal electronic device (e.g., the electronic device 1904). Forexample, if the external electronic device is an MP3 player, theapplication 1934 may include an application related to music playback.Similarly, if the external electronic device is a mobile medical device,the application 1934 may include an application related to healthcare.In one embodiment of the present disclosure, the application 1934 mayinclude at least one of an application specified in the electronicdevice 1901, or an application received from the external electronicdevice (e.g., the server 1906 or the electronic device 1904).

The I/O interface 1940 may deliver the command or data that is receivedfrom the user through an I/O device (e.g., a sensor, a keyboard or atouch screen), to the processor 1920, the memory 1930, the communicationinterface 1960 or the camera module 1970 through, for example, the bus1910. For example, the I/O interface 1940 may provide the data for auser's touch made on the touch screen, to the processor 1920. Further,the I/O interface 1940 may output, through the I/O device (e.g., aspeaker or a display), the command or data that is received from theprocessor 1920, the memory 1930, the communication interface 1960 or thecamera module 1970 through, for example, the bus 1910. For example, theI/O interface 1940 may output the voice data processed by the processor1920, to the user through the speaker.

The display 1950 may display a variety of information (e.g., multimediadata, text data, and the like), for the user.

The communication interface 1960 may connect communication between theelectronic device 1901 to the external device (e.g., the electronicdevice 1904 or the server 1906). For example, the communicationinterface 1960 may be connected to the network 1962 by wirelesscommunication or wired communication, to communicate with the externaldevice. The wireless communication may include at least one of, forexample, Wi-Fi, Bluetooth (BT), near field communication (NFC), GPS orcellular communication (e.g., long term evolution (LTE), LTE-advanced(LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA),universal mobile telecommunication system (UMTS), wireless broadband(WiBro), global system for mobile communications (GSM), and the like).The wired communication may include at least one of, for example, auniversal serial bus (USB), a high definition multimedia interface(HDMI), recommended standard 232 (RS-232), or plain old telephoneservice (POTS).

The camera module 1970 may zoom in or finely capture a specific regionby zooming in an image being captured, by being controlled based on theinformation obtained from other components (e.g., the processor 1920,the memory 1930, the I/O interface 1940, the communication interface1960, and the like).

In an embodiment of the present disclosure, the network 1962 may be atelecommunications network. The telecommunications network may includeat least one of a computer network, the Internet, Internet of things(IoT), or a telephone network. In one embodiment of the presentdisclosure, a protocol (e.g., a transport layer protocol, a data linklayer protocol or a physical layer protocol) for communication betweenthe electronic device 1901 and the external device may be supported byat least one of the application 1934, the API 1933, the middleware 1932,the kernel 1931 or the communication interface 1960.

According to various embodiments of the present disclosure, theelectronic device may calculate the lighting environment of the imagethat is being captured using an auto white balance function (or a whitebalance auto setup function). For example, using the calculated lightingenvironment, the electronic device may capture an image so that thebatch white balance may be set. Further, even in the shootingenvironment where there is no external light source, the electronicdevice may capture an image so that the batch white balance may be set,by adjusting the light source (e.g., a light emitting diode (LED) lightsource) included in the electronic device.

If the white balance is set according to the auto white balance functionduring capturing, a face region in the captured image may be set to adifferent color according to the white balance that is set to correspondto each captured image.

In order to set the color of the face region for multiple images inbatches, it is possible to use only the light source included in theelectronic device after blocking the external light source. However, anelectronic device including the light source for implementing thismethod may be large and heavy for the user to carry.

According to various embodiments of the present disclosure, theelectronic device may include a front camera or a rear camera. Forexample, if an image is captured using the front camera, the rear cameramay calculate the shooting environment to set the white balance of animage to be captured so that an image may be captured in the constantshooting environment. A detailed description thereof will be made belowwith reference to FIGS. 20A, 20B, 20C, and 21.

FIGS. 20A, 20B, and 20C illustrate a situation in which an electronicdevice analyzes face according to various embodiments of the presentdisclosure.

Referring to FIGS. 20A, 20B, and 20C, the electronic device may includea front camera 2001 or a rear camera 2002, and the rear camera 2002 mayinclude a color balance card 2003.

According to various embodiments of the present disclosure, theelectronic device may detect the lighting elements (or lightingcomponents) of the surrounding environment in which the electronicdevice is capturing an image, using the color balance card 2003. Forexample, the color balance card 2003 may be equipment for shooting thecorrect color of the light by using the scattered reflection propertiesof the light, or may be equipment that is used for color correction.Although the color balance card 2003 is mounted in, for example, therear camera 2002, the color balance card 2003 may be mounted in variousother modules interworking with the electronic device.

According to various embodiments of the present disclosure, theelectronic device may determine that the brightness of an image obtainedthrough at least one camera module (e.g., the front camera 2001 or therear camera 2002) is abnormal. For example, the case where thebrightness of the image is determined to be abnormal may include a casewhere the light is brighter or darker than the set value, or a casewhere the face region cannot be obtained.

According to various embodiments of the present disclosure, if it isdetermined that the brightness of the image is abnormal, the electronicdevice may not store the image being captured by the camera module(e.g., the front camera 2001 or the rear camera 2002), determining thatit is difficult to obtain an image.

Further, according to various embodiments of the present disclosure, ifit is determined that the brightness of the image is abnormal, theelectronic device may display a screen indicating the abnormality of theshooting situation, or output a sound alert indicating the abnormalityof the shooting situation. Accordingly, the user may move the electronicdevice to the position where the normal shooting is possible. If it isdetermined that the normal shooting is possible, the electronic devicemay output again the screen or sound indicating that shooting ispossible.

Referring to FIG. 20A, the electronic device may obtain an imageincluding a face region using the front camera 2001, and calculate thelighting elements using the color balance card 2003 of the rear camera2002.

According to various embodiments of the present disclosure, theelectronic device may apply the calculated lighting elements to theobtained image including a face region. For example, as for the image towhich the calculated lighting elements are applied, since the whitebalance is set regardless of the lighting components of the shootingsurrounding, the image may be captured so as to correspond to the whitebalance of the face region of the previously stored image.

Referring to FIG. 20B, it is assumed that the electronic device iscapturing or shooting an image using the front camera 2001. For example,the electronic device may analyze the image that is being captured bythe front camera 2001.

According to various embodiments of the present disclosure, theelectronic device may determine whether the lighting environment inwhich the electronic device is capturing an image is the extremelighting environment (e.g., backlighting, low illuminance, overly brightlighting, and the like), depending on the result of analyzing the image.For example, if the lighting environment in which the electronic deviceis capturing an image using the front camera 2001 is determined as theextreme lighting environment, the electronic device may not store theimage being captured by the front camera 2001, or control the frontcamera 2001 so that the shooting function may not be enabled.

According to various embodiments of the present disclosure, if thelighting environment in which the electronic device is capturing animage using the front camera 2001 is determined as the abnormal lightingenvironment, the electronic device may calculate the white balance usingthe color balance card 2003 and apply the calculated white balance valueto the image that is being captured by the front camera 2001.

Referring to FIG. 20C, it is assumed that the electronic device iscapturing or shooting an image using the rear camera 2002. For example,the electronic device may analyze the image that is being captured bythe rear camera 2002.

According to various embodiments of the present disclosure, theelectronic device may determine whether the lighting environment inwhich the electronic device is capturing an image is the extremelighting environment (e.g., backlighting, low illuminance, overly brightlighting, and the like), depending on the result of analyzing the image.For example, if the lighting environment in which the electronic deviceis capturing an image using the rear camera 2002 is determined as theextreme lighting environment, the electronic device may not store theimage being captured by the rear camera 2002, or control the rear camera2002 so that the shooting function may not be enabled.

According to various embodiments of the present disclosure, if thelighting environment in which the electronic device is capturing animage using the rear camera 2002 is determined as the abnormal lightingenvironment, the electronic device may calculate the white balance usingthe color balance card 2003 and apply the calculated white balance valueto the image that is being captured by the rear camera 2002.

FIG. 21 is a flowchart illustrating an operation of analyzing skininformation in an electronic device according to various embodiments ofthe present disclosure.

Referring to FIG. 21, in operation 2110, the electronic device mayobtain an image from at least one camera.

In operation 2120, the electronic device may analyze the obtained image.

In operation 2130, the electronic device may determine whether thebrightness of the obtained image is abnormal.

If it is determined in operation 2130 that the brightness of theobtained image is not abnormal, the electronic device may perform againoperation 2110.

If it is determined in operation 2130 that the brightness of theobtained image is abnormal, the electronic device may determine inoperation 2140 whether the camera that has captured the obtained imageis a camera mounted on the front of the electronic device.

If it is determined in operation 2140 that the camera that has capturedthe obtained image is not a camera mounted on the front of theelectronic device, the electronic device may calculate the white balancein operation 2150. For example, the white balance may be calculatedusing a module (e.g., the color balance card) capable of calculating thewhite balance, the module being provided in the camera that is notmounted on the front of the electronic device. In operation 2160, theelectronic device may apply the white balance of the captured image asthe calculated white balance, using the white balance calculated inoperation 2150.

If it is determined in operation 2140 that the camera that has capturedthe obtained image is a camera mounted on the front of the electronicdevice, the electronic device may apply the white balance to thecaptured image in operation 2160. For example, the image to which thewhite balance is applied in operation 2160 may be an image to which awhite balance value is applied, that is stored in advance because thecolor balance card is not provided in the camera mounted on the front ofthe electronic device.

In operation 2170, the electronic device may store the image. Forexample, the stored image may be an image to which the white balance isapplied.

At least one of operations 2110 to 2170 shown in FIG. 21 may be omitted,or at least one other operation may be added in between operations 2110to 2170. Further, operations 2110 to 2170 in FIG. 21 may be performed inthe depicted order, or at least one of operations 2110 to 2170 may bechanged in execution order.

FIGS. 22A and 22B illustrate a shooting operation for a face analysisaccording to various embodiments of the present disclosure.

Referring to FIGS. 22A and 22B, according to various embodiments of thepresent disclosure, the electronic device may determine whether anaccessory is worn in a face region being captured.

Referring to FIG. 22A, it is assumed that a high-school girl, whose faceregion is a shooting target, is wearing glasses.

According to various embodiments of the present disclosure, theelectronic device may determine whether glasses are worn on the faceregion, depending on whether the face region being captured includes aline 2211 corresponding to the rim of the glasses, or a part 2212indicating that the light is reflected on the glasses.

According to various embodiments of the present disclosure, if it isdetermined that the glasses are worn on the face region being captured,the electronic device may instruct the user or the high-school girl totake off the glasses. For example, the electronic device may display awording, for example, “Please take off your glasses before shooting” inan image 2210 being captured.

At the sight of the wording, the user of the electronic device accordingto various embodiments of the present disclosure may take off theglasses. If the electronic device determines that the user has taken offthe glasses, the electronic device may display a wording, for example,“You can shoot” in an image 2220 being captured.

Referring to FIG. 22B, it is assumed that a high-school girl, whose faceregion is a shooting target, is wearing a hat.

According to various embodiments of the present disclosure, theelectronic device may determine whether a hat is worn on the faceregion, depending on whether the face region being captured includes aline 2231 corresponding to the shape of the hat.

According to various embodiments of the present disclosure, if it isdetermined that the hat is worn on the face region being captured, theelectronic device may instruct the user or the high-school girl to takeoff the hat. For example, the electronic device may display a wording,for example, “Please take off your hat before shooting” in an image 2230being captured.

At the sight of the wording, the user of the electronic device accordingto various embodiments of the present disclosure may take off the hat.If the electronic device determines that the user has taken off the hat,the electronic device may display a wording, for example, “You canshoot” in an image 2240 being captured.

FIGS. 23A and 23B illustrate a shooting operation for a face analysisaccording to various embodiments of the present disclosure.

Referring to FIGS. 23A and 23B, according to various embodiments of thepresent disclosure, a line 2301 corresponding to the face region may bedisplayed on the electronic device so that the user may identify thedirection or size of the face region being captured.

Referring to FIG. 23A, it is assumed that a high-school girl, whose faceregion is a shooting target, is shooting herself, with her face tilted.

According to various embodiments of the present disclosure, theelectronic device may determine whether the face region is beingcaptured at the correct position, depending on whether the face regionbeing captured is out of the line 2301.

According to various embodiments of the present disclosure, if it isdetermined that the face region being captured is out of the line 2301,the electronic device may instruct the user or the high-school girl toput her face at the correct position. For example, the electronic devicemay display a wording, for example, “Please put your face at the correctposition” in an image 2311 being captured.

At the sight of the wording, the user of the electronic device accordingto various embodiments of the present disclosure may put her face inline with the line 2301. If the electronic device determines that theuser has put her face at the correct position, the electronic device maydisplay a wording, for example, “You can shoot” in an image 2312 beingcaptured.

Referring to FIG. 23B, it is assumed that a high-school girl, whose faceregion is a shooting target, is shooting herself at a distance.

According to various embodiments of the present disclosure, theelectronic device may determine whether the face region is captured at adistance or at a close distance, depending on whether the size of theface region being captured matches the size of the line 2301.

According to various embodiments of the present disclosure, if it isdetermined that the face region being captured is captured at a distancesince the size of the face region is smaller than the size of the line2301, the electronic device may instruct the user or the high-schoolgirl to put her face closer. For example, the electronic device maydisplay a wording, for example, “Please put your face closer” in animage 2321 being captured.

At the sight of the wording, the user of the electronic device accordingto various embodiments of the present disclosure may put her face inline with the line 2301. If the electronic device determines that theuser has put her face closer, the electronic device may display awording, for example, “You can shoot” in an image 2322 being captured.

FIG. 24 illustrates a shooting operation for a face analysis accordingto various embodiments of the present disclosure.

Referring to FIG. 24, it is assumed that an image 2410 is capturedshaking in the electronic device.

According to various embodiments of the present disclosure, theelectronic device may operate an image stabilization function, if theelectronic device cannot identify the shape of the face region in theimage being captured, or if the electronic device detects the shaking ofthe electronic device through the sensor, and the like. For example, theimage stabilization function may include a function of preventing theimage from being captured shaking, by adjusting the shutter speed or theaperture during image capturing.

According to various embodiments of the present disclosure, after theimage stabilization function is set, the electronic device may display awording, for example, “You can shoot” in an image 2420 being capture.For example, at the sight of the wording, the user may shoot her face.

FIG. 25 is a block diagram illustrating a configuration of an electronicdevice according to various embodiments of the present disclosure.

Referring to FIG. 25, an electronic device 2501 may constitute the wholeor part of the electronic device 100 or 1901 shown in, for example, FIG.1 or 19.

The electronic device 2501 may include at least one processor (e.g., anapplication processor (AP) 2510), a communication module 2520, asubscriber identification module (SIM) card 2524, a memory 2530, asensor module 2540, an input device 2550, a display 2560, an interface2570, an audio module 2580, a camera module 2591, a power managementmodule 2595, a battery 2596, an indicator 2597, and a motor 2598.

The AP 2510 may control a plurality of hardware or software componentsconnected to the AP 2510 by running the operating system or applicationprogram, and may process and calculate various data including multimediadata. The AP 2510 may be implemented as, for example, a system on chip(SoC). In one embodiment of the present disclosure, the AP 2510 mayfurther include a graphics processing unit (GPU) (not shown).

The communication module 2520 (e.g., the communication interface 1960)may perform data transmission/reception in communication between theelectronic device 2501 (e.g., the electronic device 100 or theelectronic device 1901) and other electronic devices (e.g., theelectronic device 1904 or the server 1906) connected to the electronicdevice 2501 over the network. In one embodiment of the presentdisclosure, the communication module 2520 may include a cellular module2521, a Wi-Fi module 2523, a BT module 2525, a GPS module 2527, an NFCmodule 2528, and a radio frequency (RF) module 2529.

The cellular module 2521 may provide a voice call service, a video callservice, a messaging service or an Internet service over a communicationnetwork (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, GSM, and the like).Further, the cellular module 2521 may perform identification andauthentication of an electronic device in the communication network byusing, for example, a SIM (e.g., the SIM card 2524). In one embodimentof the present disclosure, the cellular module 2521 may perform at leastsome of the functions that can be provided by the AP 2510. For example,the cellular module 2521 may perform at least a part of the multimediacontrol function.

In an embodiment of the present disclosure, the cellular module 2521 mayinclude a communication processor (CP). Further, the cellular module2521 may be implemented as, for example, an SoC. Although thecomponents, such as the cellular module 2521 (e.g., the CP), the memory2530 or the power management module 2595 are shown as separatecomponents from the AP 2510 in FIG. 25, the AP 2510 may be implementedto include at least some (e.g., the cellular module 2521) of theabove-described components according to an embodiment of the presentdisclosure.

In an embodiment of the present disclosure, the AP 2510 or the cellularmodule 2521 (e.g., the CP) may load, on a volatile memory, the commandor data that is received from at least one of a non-volatile memory oranother component connected thereto, and process the loaded command ordata. Further, the AP 2510 or the cellular module 2521 may store, in anon-volatile memory, the data that is received from or generated by atleast one of other components.

Each of the Wi-Fi module 2523, the BT module 2525, the GPS module 2527or the NFC module 2528 may include, for example, a processor forprocessing the data transmitted or received through the correspondingmodule. Although the cellular module 2521, the Wi-Fi module 2523, the BTmodule 2525, the GPS module 2527 or the NFC module 2528 are shown astheir separate blocks in FIG. 25, at least some (e.g., two or more) ofthe cellular module 2521, the Wi-Fi module 2523, the BT module 2525, theGPS module 2527 or the NFC module 2528 may be included in one integratedchip (IC) or IC package according to an embodiment of the presentdisclosure. For example, at least some (e.g., a CP corresponding to thecellular module 2521 or a Wi-Fi processor corresponding to the Wi-Fimodule 2523) of processors corresponding to the cellular module 2521,the Wi-Fi module 2523, the BT module 2525, the GPS module 2527 or theNFC module 2528 may be implemented as one SoC.

The RF module 2529 may perform transmission/reception of data, forexample, transmission/reception of RF signals. The RF module 2529,although not shown, may include, for example, a transceiver, a poweramplifier module (PAM), a frequency filter, a low noise amplifier (LNA),and the like. The RF module 2529 may further include the part (e.g.,conductor or conducting wire) for transmitting and receivingelectromagnetic waves in the free space in wireless communication.Although the cellular module 2521, the Wi-Fi module 2523, the BT module2525, the GPS module 2527 and the NFC module 2528 are shown to share oneRF module 2529 with each other in FIG. 25, at least one of the cellularmodule 2521, the Wi-Fi module 2523, the BT module 2525, the GPS module2527 or the NFC module 2528 may perform transmission/reception of RFsignals through a separate RF module according to an embodiment of thepresent disclosure.

The SIM card 2524 may be a card with a SIM, and may be inserted into aslot that is formed in a specific position of the electronic device. TheSIM card 2524 may include unique identification information (e.g.,integrated circuit card identifier (ICCID)) or subscriber information(e.g., international mobile subscriber identity (IMSI)).

The memory 2530 (e.g., the storage 150 or the memory 1930) may includean internal memory 2532 or an external memory 2534. The internal memory2532 include at least one of, for example, a volatile memory (e.g., adynamic random access memory (DRAM), a static RAM (SRAM), a synchronousdynamic RAM (SDRAM), and the like) or a non-volatile memory (e.g., a onetime programmable read only memory (OTPROM), a programmable ROM (PROM),an erasable and programmable ROM (EPROM), an electrically erasable andprogrammable ROM (EEPROM), a mask ROM, a flash ROM, a NAND flash memory,a NOR flash memory, and the like).

In an embodiment of the present disclosure, the internal memory 2532 maybe a solid state drive (SSD). The external memory 2534 may furtherinclude a flash drive, for example, compact flash (CF), secure digital(SD), micro-SD, mini-SD, extreme digital (xD), a memory stick, and thelike. The external memory 2534 may be functionally connected to theelectronic device 2501 through various interfaces. In one embodiment ofthe present disclosure, the electronic device 2501 may further include astorage device (or a storage medium), such as a hard drive.

The sensor module 2540 may measure the physical quantity or detect theoperating status of the electronic device 2501, and convert the measuredor detected information into an electrical signal. The sensor module2540 may include at least one of, for example, a gesture sensor 2450A, agyro sensor 2540B, a barometer 2540C, a magnetic sensor 2540D, anaccelerometer 2540E, a grip sensor 2540F, a proximity sensor 2540G, acolor sensor (e.g., red, green, blue (RGB) sensor) 2450H, a biosensor2450I, a temperature/humidity sensor 2540J, an illuminance sensor 2540K,or a ultra violet (UV) sensor 2540M. Additionally or alternatively, thesensor module 2540 may include, for example, an E-nose sensor (notshown), an electromyography (EMG) sensor (not shown), anelectroencephalogram (EEG) sensor (not shown), an electrocardiogram(ECG) sensor (not shown), an infrared (IR) sensor (not shown), an irissensor (not shown), a fingerprint sensor (not shown), and the like. Thesensor module 2540 may further include a control circuit for controllingat least one or more sensors belonging thereto.

The input device 2550 may include a touch panel 2552, a (digital) pensensor 2554, a key 2556, or an ultrasonic input device 2558. The touchpanel 2552 may recognize a touch input in at last one of, for example,capacitive, resistive, IR or ultrasonic manner. The touch panel 2552 mayfurther include a control circuit. In the case of the capacitive scheme,the touch panel 2552 may recognize the physical contact or proximity.The touch panel 2552 may further include a tactile layer. In this case,the touch panel 2552 may provide a tactile or haptic feedback to theuser.

The (digital) pen sensor 2554 may be implemented by using, for example,the method same as or similar to receiving a user's touch input, or aseparate recognition sheet. The key 2556 may include, for example, aphysical button, an optical key or a keypad. The ultrasonic input device2558 is a device by which the electronic device 2501 can determine databy detecting sound waves with a microphone (e.g., a microphone 2588)through an input tool for generating an ultrasonic signal. Theultrasonic input device 2558 enables wireless recognition. In oneembodiment of the present disclosure, the electronic device 2501 mayreceive a user input from the external device (e.g., a computer or aserver) connected thereto using the communication module 2520.

The display 2560 (e.g., the display 140 or the display 1950) may includea panel 2562, a hologram device 2564, or a projector 2566. The panel2562 may be, for example, a liquid-crystal display (LCD) panel or anactive-matrix organic LED (AM-OLED) panel. The panel 2562 may beimplemented to be, for example, flexible, transparent or wearable. Thepanel 2562, together with the touch panel 2552, may be implemented asone module. The hologram device 2564 may show stereoscopic images in theair using the interference of the light. The projector 2566 may displayimages by projecting the light on the screen. The screen may be disposedon the inside or outside of, for example, the electronic device 2501. Inone embodiment of the present disclosure, the display 2560 may furtherinclude a control circuit for controlling the panel 2562, the hologramdevice 2564, or the projector 2566.

The interface 2570 may include, for example, an HDMI 2572, a USB 2574,an optical interface 2576 or D-subminiature (D-sub) 2578. The interface2570 may be included in, for example, the communication interface 1960shown in FIG. 19. Additionally or alternatively, the interface 2570 mayinclude, for example, a mobile high-definition link (MHL) interface, aSD card/multi-media card (MMC) interface or an infrared data association(IrDA) interface.

The audio module 2580 may convert the sound and electrical signalsbi-directionally. At least some components of the audio module 2580 maybe included in, for example, the I/O interface 1940 shown in FIG. 19.The audio module 2580 may process the sound information that is receivedor output through, for example, a speaker 2582, a receiver 2584, anearphone 2586 or the microphone 2588.

The camera module 2591, which is a device capable of capturing stillimages and videos, may include one or more image sensors (e.g., a frontimage sensor or a rear image sensor), a lens (not shown), an imagesignal processor (ISP) (not shown), or a flash (not shown) (e.g., an LEDor xenon lamp) according to an embodiment of the present disclosure.

The power management module 2595 may manage the power of the electronicdevice 2501. Although not shown, the power management module 2595 mayinclude, for example, a power management integrated circuit (PMIC), acharger IC, or a battery or fuel gauge.

The PMIC may be mounted in, for example, an integrated circuit or an SoCsemiconductor chip. A charging scheme may be divided into a wiredcharging scheme and a wireless charging scheme. The charger IC maycharge a battery, and prevent the inflow of over voltage or over currentfrom the charger. In one embodiment of the present disclosure, thecharger IC may include a charger IC for at least one of the wiredcharging scheme or the wireless charging scheme. The wireless chargingscheme may include, for example, a magnetic resonance scheme, a magneticinduction scheme, or an electromagnetic scheme. An additional circuit(e.g., a coil loop, a resonance circuit, a rectifier, and the like) forwireless charging may be added.

The battery or fuel gauge may measure, for example, the remainingcapacity, charging voltage, charging current or temperature of thebattery 2596. The battery 2596 may store or generate the electricity,and supply the power to the electronic device 2501 using the stored orgenerated electricity. The battery 2596 may include, for example, arechargeable battery or a solar battery.

The indicator 2597 may indicate specific status (e.g., a boot status, amessage status, a charging status, and the like) of the electronicdevice 2501 or a part (e.g., the AP 2510) thereof. The motor 2598 mayconvert an electrical signal into mechanical vibrations. Although notshown, the electronic device 2501 may include a processing device (e.g.,a GPU) for mobile TV support. The processing device for mobile TVsupport may process media data based on the standards, such as, forexample, digital multimedia broadcasting (DMB), digital videobroadcasting (DVB), or mediaFLO, and the like.

Each of above-described components of the electronic device according tovarious embodiments of the present disclosure may be configured with oneor more components, and names of the components may vary depending onthe type of the electronic device. The electronic device according tovarious embodiments of the present disclosure may include at least oneof the above-described components, some of which may be omitted, or mayfurther include additional other components. Further, some of thecomponents of the electronic device according to various embodiments ofthe present disclosure may be configured as one entity by beingcombined, thereby performing the previous functions of the components inthe same manner.

The term ‘module’ used in various embodiments of the present disclosuremay refer to a unit that includes, for example, one or a combination ofhardware, software or firmware. The term ‘module’ may be interchangeablyused with terms, such as, for example, unit, logic, logical block,component, or circuit. The module may be the minimum unit of anintegrally constructed part or a part thereof. The module may be theminimum unit for performing one or more functions, or a part thereof.The module may be implemented mechanically or electronically. Forexample, the module according to various embodiments of the presentdisclosure may include at least one of an application-specificintegrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs),or a programmable-logic device, which are known or will be developed inthe future, and which perform certain operations.

At least a part of the device (e.g., modules or functions thereof) ormethod (e.g., operations) according to various embodiments of thepresent disclosure may be implemented by a command that is stored incomputer-readable storage media in the form of, for example, aprogramming module. If the command is executed by one or more processors(e.g., the controller 110 or the processor 1920), the one or moreprocessors may perform a function corresponding to the command. Thecomputer-readable storage media may be, for example, the storage 150 orthe memory 1930. At least a part of the programming module may beimplemented (e.g., executed) by, for example, the controller 110 or theprocessor 1920. At least a part of the programming module may include,for example, a module, a program, a routine, a set of instructions, or aprocessor for performing one or more functions.

Certain aspects of the present disclosure can also be embodied ascomputer readable code on a non-transitory computer readable recordingmedium. A non-transitory computer readable recording medium is any datastorage device that can store data which can be thereafter read by acomputer system. Examples of the non-transitory computer readablerecording medium include a Read-Only Memory (ROM), a Random-AccessMemory (RAM), Compact Disc-ROMs (CD-ROMs), magnetic tapes, floppy disks,and optical data storage devices. The non-transitory computer readablerecording medium can also be distributed over network coupled computersystems so that the computer readable code is stored and executed in adistributed fashion. In addition, functional programs, code, and codesegments for accomplishing the present disclosure can be easilyconstrued by programmers skilled in the art to which the presentdisclosure pertains.

At this point it should be noted that the various embodiments of thepresent disclosure as described above typically involve the processingof input data and the generation of output data to some extent. Thisinput data processing and output data generation may be implemented inhardware or software in combination with hardware. For example, specificelectronic components may be employed in a mobile device or similar orrelated circuitry for implementing the functions associated with thevarious embodiments of the present disclosure as described above.Alternatively, one or more processors operating in accordance withstored instructions may implement the functions associated with thevarious embodiments of the present disclosure as described above. Ifsuch is the case, it is within the scope of the present disclosure thatsuch instructions may be stored on one or more non-transitory processorreadable mediums. Examples of the processor readable mediums include aROM, a RAM, CD-ROMs, magnetic tapes, floppy disks, and optical datastorage devices. The processor readable mediums can also be distributedover network coupled computer systems so that the instructions arestored and executed in a distributed fashion. In addition, functionalcomputer programs, instructions, and instruction segments foraccomplishing the present disclosure can be easily construed byprogrammers skilled in the art to which the present disclosure pertains.

A module or a programming module according to various embodiments of thepresent disclosure may include at least one of the above-describedcomponents, some of which may be omitted, or may further includeadditional other components. Operations performed by a module, aprogramming module or other components according to various embodimentsof the present disclosure may be performed in a sequential, parallel,iterative or heuristic way. Some operations may be performed in adifferent order or omitted, or other operations may be added.

According to various embodiments of the present disclosure, in a storagemedium storing instructions, when the instructions are executed by atleast one processor, the instructions are set to allow the at least oneprocessor to perform at least one operation. The at least one operationmay include an operation of detecting at least one face region from animage that is being captured by a camera module, an operation of zoomingin the at least one detected face region, and an operation of analyzingthe zoomed in face region according to at least one analysis item.

According to various embodiments of the present disclosure, the at leastone operation may include an operation of detecting a face region fromat least one stored image, and an operation of analyzing the at leastone detected face region according to at least one analysis item.

According to various embodiments of the present disclosure, theoperation of analyzing face information may be performed based on apreviously stored image. For example, the stored image may be an imagethat was captured in a preset distance or at a preset angle according toa preset fixed focus value. If a user's face is in a positioncorresponding to the set distance or angle, the electronic device maycapture a face image, or display a screen for requesting the user tocapture a face region to correspond to the distance or angle.

According to various embodiments of the present disclosure, the storedimage may be captured and stored in a predetermined situation so thatthe user may not execute the shooting operation. For example, in asituation where the user watches the electronic device for apredetermined time or more (e.g., the user determines the web browser,or views a media file (e.g., video)), or in a situation where theelectronic device is located at an angle at which the electronic devicecan capture the user's face image (e.g., in a situation where theelectronic device can capture the user's face in the front directiondepending on the angle of the front camera), the electronic device maycapture the user's face image by operating the camera module in thebackground.

According to various embodiments of the present disclosure, theelectronic device may determine a stored image, remove, from the image,the portions (e.g., shadows or hairs), analysis of which is unnecessary,and set at least one reference point in the region where the unnecessaryportions are removed, thereby to determine the face region. For example,the reference point may be set on the entire face region in the image,and may be set based on the pre-analyzed data base or the previouslyanalyzed specific user's face image so that each face region (e.g., a Czone, an M zone, a U zone, eyes, nose, cheeks, mouth, and the like) maybe identified.

According to various embodiments of the present disclosure, uponidentifying a face region in a previously stored image, the electronicdevice may output the result of analyzing skin conditions of each regionthrough an analysis result screen.

According to various embodiments of the present disclosure, an operationof analyzing face information may be performed based on the previouslystored image. For example, the electronic device may set at least onereference point on an image, and determine a face region based on theset reference point.

According to various embodiments of the present disclosure, upondetermining a face region in a previously stored image, the electronicdevice may output the result of analyzing skin conditions of each regionthrough an analysis result screen.

FIG. 26 illustrates a screen of an application for analyzing faceinformation based on a stored image according to various embodiments ofthe present disclosure.

Referring to FIG. 26, if an application for analyzing face informationis run, an execution screen 2610 may include a Gallery button 2611 forrunning a gallery application for displaying images stored in theelectronic device, or a Camera button 2612 for enabling the cameramodule to switch to a screen for capturing an image.

According to various embodiments of the present disclosure, the imagesthat are displayed as the Gallery button 2611 is selected may include aselection item by which the user may select the images, or may includefiltered images, face information of which can be analyzed, among theimages stored in the electronic device. The images, face information ofwhich can be analyzed, may be images in which the face region iscaptured to correspond to a predetermined angle or size.

According to various embodiments of the present disclosure, if theGallery button 2611 is selected, an image selection screen 2620 may bedisplayed, on which the user can select at least one image, faceinformation of which is to be analyzed. For example, the imagesdisplayed on the image selection screen 2620 may be arranged in the lastcaptured or stored order.

According to various embodiments of the present disclosure, if the userselects at least one of the images included in the image selectionscreen 2620 as an image whose face information is to be analyzed, ananalysis result screen 2630 for displaying the result of analyzing theselected images may be displayed.

According to various embodiments of the present disclosure, the analysisresult screen 2630 may include a region 2631 in which the result ofanalyzing face information is displayed in the image, a region 2632 inwhich the result of analyzing face information is displayed numericallyor in a graph, or buttons by which the user can select the analysisresults for each analysis item, and may also include various other itemsrelated to face analysis. For example, the buttons by which the user canselect the analysis results for each analysis item may include a Summarybutton 2633 a for displaying the analysis results for the entire faceregion, a Wrinkle button 2633 b for displaying the analysis results forwrinkles, a Trouble button 2633 c for displaying the analysis resultsfor skin troubles, or a Pigmentation button 2633 d for displaying theanalysis results for pigmentation, and may also include other selectionitems for displaying the analysis results for various other analysisitems.

FIG. 27 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 27, an analysis result screen 2700 may include animage region 2710 in which the analyzed face region is displayed, ananalysis result region 2720 in which the analysis results are displayed,or an analysis item selection region 2730 for selecting the analysisresults for each analysis item.

In the image region 2710, a face region may be detected from an imagestored in the electronic device and at least one reference point 2711may be set in the detected face region. Based on the at least onereference point 2711, a face region (e.g., 2712, 2713, 2714, 2715, or2716) to be analyzed may be set according to at least one analysis item.The region 2712 may include a region of outer parts of both eyes as a Czone. The region 2713 may include a nose region, the region 2714 mayinclude a cheek region, the region 2715 may include a region around thenose, and the region 2716 may include a region around the mouth.

According to various embodiments of the present disclosure, each of theface regions may be selected as a user input (e.g., a touch gesture) ismade, and as for the selected face region, a screen obtained byanalyzing the face region may be zoomed in and displayed.

In the analysis result region 2720, the result of analyzing the skinconditions may be displayed numerically (e.g., may be displayed in thestate of a score 2722 or a graph 2721). For example, the graph 2721 mayrepresent the score of the skin conditions for each analysis item byanalyzing a specific face region for each analysis item. The score 2722may be a value obtained by averaging a score of each analysis item for aspecific face region, and as the score 2722 is higher, the skinconditions may be better.

The analysis item selection region 2730 may include at least one buttonfor displaying the analysis results of each analysis item, and dependingon the selected button, the analysis results for a specific face regionmay be displayed in the image region 2710 or the analysis result region2720. For example, if the Summary button is selected, the entire faceregion may be displayed in the image region 2710, and the analysisresults for the entire face region may be displayed in the analysisresult region 2720.

FIG. 28 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 28, an analysis result screen 2800 may include animage region 2810 in which at least one of analyzed face regions can beselected, an analysis result region 2820, or an analysis item selectionregion 2830.

According to various embodiments of the present disclosure, if a Wrinklebutton 2831 is selected in the analysis item selection region 2830, theresult of analyzing wrinkles among various analysis items may bedisplayed in the image region 2810 or the analysis result region 2820.

In the image region 2810, based on the images stored in the electronicdevice, the result of analyzing wrinkles in at least one face region(e.g., a region of the C zone or U zone) may be displayed in an image.For example, since each face region is displayed in a different colordepending on the skin conditions, the user may determine the skinconditions based on the displayed skin color.

In the analysis result region 2820, a graph 2821 obtained by comparingthe result of analyzing wrinkles with an average score for each of the Czone or M zone, or a score 2822 for wrinkles in the entire face regionmay be displayed.

According to various embodiments of the present disclosure, if the usermakes a user input 2811 in a specific region (e.g., a left C-zoneregion) to determine the analysis results, a zoomed in screen 2812 maybe displayed, on which the region (e.g., the left C-zone region) wherethe user input is made, is analyzed.

According to various embodiments of the present disclosure, the analysisresult region 2820 may provide the history of a change in wrinkles forthe entire face region. For example, the analysis result region 2820 mayinclude a graph 2823 obtained by comparing the wrinkle state measuredone month ago with the currently measured wrinkle state, or a graph 2824indicating how much the wrinkle state of the C zone or M zone has beenimproved than before.

FIG. 29 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 29, the user has selected a Wrinkle button 2931 in theanalysis item selection region. Accordingly, an analysis result screen2900 may include an image obtained by analyzing the wrinkles, or ananalysis result region 2920.

In the analysis result region 2920, the wrinkle state for each ofspecific regions (e.g., the left CL or right CR of the C zone, or theleft ML or right MR of the M zone) or the wrinkle state in the entireface region may be displayed in score.

According to various embodiments of the present disclosure, the user mayselect a region where the user desires to determine the zoomed in ordetailed screen among the analyzed face regions. For example, if theleft C-zone region is selected by a user input 2901, a screen 2910 maybe displayed, on which the left region of the C zone is zoomed in theface. If the left region of the nose is selected by a user input 2902, ascreen 2920 may be displayed, on which the left region of the nose iszoomed in the face.

FIG. 30 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 30, if the user selects a Trouble button 3031 in ananalysis item selection region 3030 of an analysis result screen 3000,the result of analyzing troubles among various analysis items may bedisplayed in an image region 3010 or an analysis result region 3020 ofthe analysis result screen 3000.

In the image region 3010, based on the images stored in the electronicdevice, the result of analyzing at least one face region (e.g., a rightregion R, a left region L, a top region T or a bottom region B) analyzedfor troubles may be displayed in an image. For example, since each faceregion is displayed in a different color depending on the skinconditions, the user may determine the skin conditions of the faceregion based on the displayed skin color.

In the analysis result region 3020, a graph 3021 obtained by comparingthe result of analyzing troubles with an average score for each of theright region R, the left region L, the top region T or the bottom regionB, or a score 3022 for troubles in the entire face region may bedisplayed.

According to various embodiments of the present disclosure, if thebottom of the face is selected by a user input 3011, a zoomed in screen3012 may be displayed, on which the bottom region is analyzed. Forexample, based on the zoomed in screen 3012, the user may determine theposition and size of the troubles in the bottom region.

According to various embodiments of the present disclosure, the analysisresult region 3020 may provide the history of a change in troubles forthe entire face region. For example, the analysis result region 3020 mayinclude a graph 3023 obtained by comparing the trouble state measuredone month ago with the currently measured trouble state, or a graph 3024indicating how much the trouble state of each region (e.g., the rightregion R, the left region L, the top region T or the bottom region B)has been improved than before.

FIG. 31 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 31, the user has selected a Trouble button 3131 in theanalysis item selection region. Accordingly, an analysis result screen3100 may include an image obtained by analyzing the troubles, or ananalysis result region 3120.

According to various embodiments of the present disclosure, the user mayselect a region where the user desires to determine the zoomed in ordetailed screen among the analyzed face regions. For example, if theleft cheek region is selected by a user input 3101, a screen 3110 may bedisplayed, on which the left cheek of the face is zoomed in. If thebottom is selected by a user input 3102, a screen 3120 may be displayed,on which the bottom of the face is zoomed in.

FIG. 32 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 32, if the user selects a Pigmentation button 3231 inan analysis item selection region 3230 of an analysis result screen3200, the result of analyzing the pigmentation among various analysisitems may be displayed in an image region 3210 or an analysis resultregion 3220 of the analysis result screen 3200.

In the image region 3210, based on the images stored in the electronicdevice, the result of analyzing at least one face region (e.g., theright region R, the left region L, the top region T or the bottom regionB) analyzed for pigmentation may be displayed in an image. For example,since each face region is displayed in a different color depending onthe skin conditions, the user may determine the skin conditions of theface region based on the displayed skin color.

In the analysis result region 3220, a graph 3221 obtained by comparingthe result of analyzing the pigmentation with an average score for eachof the right region R, the left region L, the top region T or the bottomregion B, or a score 3222 for pigmentation in entire face region may bedisplayed.

According to various embodiments of the present disclosure, if the leftcheek is selected by a user input 3201, a zoomed in screen 3202 may bedisplayed, on which the left cheek region is analyzed. For example,based on the zoomed in screen 3202, the user may determine the positionand size of the pigmentation spots in the left cheek region.

According to various embodiments of the present disclosure, the analysisresult region 3220 may provide the history of a change in pigmentationfor the entire face region. For example, the analysis result region 3220may include a graph 3223 obtained by comparing the pigmentation statemeasured one month ago with the currently measured pigmentation state,or a graph 3224 indicating how much the pigmentation state of eachregion (e.g., the right region R, the left region L, the top region T orthe bottom region B) has been improved than before.

FIG. 33 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 33, the user has selected a Pigmentation button 3331in the analysis item selection region. Accordingly, an analysis resultscreen 3300 may include an image obtained by analyzing the pigmentation,or an analysis result region 3320.

According to various embodiments of the present disclosure, the user mayselect a region where the user desires to determine the zoomed in ordetailed screen among the analyzed face regions. For example, if theleft cheek region is selected by a user input 3301, a screen 3311 may bedisplayed, on which the left cheek of the face is zoomed in. If the noseregion is selected by a user input 3302, a screen 3312 may be displayed,on which the nose region is zoomed in.

FIG. 34 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 34, if the user selects a Pore button 3431 in ananalysis item selection region 3430 of an analysis result screen 3400,the result of analyzing the pores among various analysis items may bedisplayed in an image region 3410 or an analysis result region 3420 ofthe analysis result screen 3400.

In the image region 3410, based on the images stored in the electronicdevice, the result of analyzing at least one face region (e.g., theright region R, the left region L, the top region T or the bottom regionB) analyzed for pores may be displayed in an image. For example, sinceeach face region is displayed in a different color depending on the skinconditions, the user may determine the skin conditions of the faceregion based on the displayed skin color.

In the analysis result region 3420, a graph 3421 obtained by comparingthe result of analyzing the pores with an average score for each of theright region R, the left region L, the top region T or the bottom regionB, or a score 3422 for pores in the entire face region may be displayed.

According to various embodiments of the present disclosure, if the rightcheek is selected by a user input 3401, a zoomed in screen 3402 may bedisplayed, on which the right cheek region of the face is analyzed. Forexample, based on the zoomed in screen 3402, the user may determine theposition and size of the pores in the right cheek region.

According to various embodiments of the present disclosure, the analysisresult region 3420 may provide the history of a change in pores for theentire face region. For example, the analysis result region 3420 mayinclude a graph 3423 obtained by comparing the pore state measured onemonth ago with the currently measured pore state, or a graph 3424indicating how much the pore state of the entire face region has beenimproved than before.

FIG. 35 illustrates a screen showing face analysis results according tovarious embodiments of the present disclosure.

Referring to FIG. 35, if the user selects a Tone button 3531 in ananalysis item selection region 3530 of an analysis result screen 3500,the result of analyzing skin tones among various analysis items may bedisplayed in an image region 3510 or an analysis result region 3520 ofthe analysis result screen 3500.

In the image region 3510, based on the images stored in the electronicdevice, the result of analyzing at least one face region (e.g., a browregion L, a cheek region A, or a jaw region B) analyzed for skin tonesmay be displayed in an image. For example, since each face region isdisplayed in a different color depending on the skin conditions, theuser may determine the skin conditions of the face region based on thedisplayed skin color.

In the analysis result region 3520, a graph 3521 obtained by comparingthe result of analyzing the uniformity of skin tones with an averagescore for each of the brow region L, the cheek region A or the jawregion B, or a score 3522 for the uniformity of pores in the entire faceregion may be displayed.

According to various embodiments of the present disclosure, if the userselects the score 3522, the analysis result region 3520 may provide theanalysis results for the change in skin tones for the entire faceregion. For example, the analysis result region 3520 may include a graph3523 obtained by comparing the tone state (or the uniformity state oftone) measured one month ago with the currently measured tone state foreach face region (e.g., the brow region L, the cheek region A or the jawregion B), or a graph 3524 indicating how much the tone state of eachface region has been improved than before.

FIG. 36 illustrates an application screen showing a history of faceinformation analyzed based on a stored image according to variousembodiments of the present disclosure.

Referring to FIG. 36, if an analysis result screen 3600 including theresult of analyzing face information using an application for analyzingface information is displayed, a menu 3601 including a function relatedto the analyzed face information may be displayed. For example, if themenu 3601 is selected, selection items may be displayed, by which theuser can select an Analyze Whole Image function of analyzing at leastone selected image on a trial basis, a Manage Changes function 3602 ofdisplaying the history of the analyzed face information, or anInitialize DB function of initializing the data in the previouslyanalyzed face information. Various other functions related to theanalysis of face information may be included in the menu 3601.

According to various embodiments of the present disclosure, if the userselects the Manage Changes function 3602, a change in the previouslyanalyzed face information may be displayed in an image region 3610 or ananalysis result region 3620 of the analysis result screen 3600. Forexample, the analysis result region 3620 may display the result of theface analysis for each analysis item using a graph 3621 for a timeperiod in which the face information is analyzed. In the image region3610, an image may be displayed that is obtained by analyzing the faceinformation at a specific time when the user input is made in the graph3621. A display section of analysis items 3630 may display analysisitems, such as Summary 3631, Wrinkle 3632, Trouble 3633, andPigmentation 3634.

FIG. 37 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 37, the user may select an analysis item or an imageregion where the user desires to determine a change in the analysisresult, on an analysis result screen 3700. For example, in order todetermine a change in the analysis result of the pigmentation, the usermay select a button of Summary among analysis items (e.g., Summary,Wrinkle, Trouble, or Pigmentation).

According to various embodiments of the present disclosure, the user maymake a user input (e.g., pinch in/out, or tap-and-drag) 3701 to zoomin/out an image displayed in the image region, or may move the image toset an image region where the user desires to determine a change in theanalysis result.

According to various embodiments of the present disclosure, the analysisresult screen 3700 may display the set image region, and display achange in the result of analyzing the displayed image region accordingto at least one analysis item (e.g., pigmentation, troubles orwrinkles), using a graph. For example, the graph shows the time in whichthe face information is analyzed, and the analysis results correspondingto the time. If a user input is made as a specific time, an image whoseface information is analyzed at the time may be displayed.

FIG. 38 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 38, an analysis result screen 3800 may include animage region 3810 or an analysis result region 3820.

According to various embodiments of the present disclosure, in order todetermine a change in the analysis result of the wrinkles, the user mayselect Wrinkle 3831 among analysis items (e.g., Summary, Wrinkle,Trouble, or Pigmentation).

In the image region 3810, the result of analyzing the wrinkles in theface region of the image may be displayed. For example, the result ofanalyzing the wrinkles may be displayed in the form of a line, and thedepth or length of the wrinkles may be represented depending on thethickness or length of the line.

The analysis result region 3820 may represent the previously analyzedtime-based wrinkle state for each face region (e.g., the right region CRor left region CL of the C zone, or the right region MR or left regionML of the M zone) as the result of analyzing the wrinkles, using agraph.

According to various embodiments of the present disclosure, if the usermakes a user input (e.g., tap or swipe) as a specific time on the graph,an image used to analyze wrinkles at the time may be displayed in theimage region 3810, and the result of analyzing the wrinkles at the timemay be displayed on the displayed image.

FIG. 39 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 39, an analysis result screen 3900 may include animage region 3910 or an analysis result region 3920.

According to various embodiments of the present disclosure, in order todetermine a change in the analysis result of the troubles, the user mayselect Trouble 3931 among analysis items (e.g., Summary, Wrinkle,Trouble, or Pigmentation).

In the image region 3910, the result of analyzing the troubles in theface region of the image may be displayed. For example, the result ofanalyzing the troubles may be displayed in the form corresponding to thetroubles, and the size or state of the troubles may be representeddepending on the size or color of the troubles.

The analysis result region 3920 may represent the previously analyzedtime-based trouble state for each face region (e.g., the right region R,the left region L, the top region T or the bottom region B) as theresult of analyzing the troubles, using a graph.

According to various embodiments of the present disclosure, if the usermakes a user input (e.g., tap or swipe) as a specific time on the graph,an image used to analyze troubles at the time may be displayed in theimage region 3910, and the result of analyzing the troubles at the timemay be displayed on the displayed image.

FIG. 40 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 40, an analysis result screen 4000 may include animage region 4010 or an analysis result region 4020.

According to various embodiments of the present disclosure, in order todetermine a change in the analysis result of the pigmentation, the usermay select Pigmentation 4031 among analysis items (e.g., Summary,Wrinkle, Trouble, or Pigmentation).

In the image region 4010, the result of analyzing the pigmentation inthe face region of the image may be displayed. For example, the resultof analyzing the pigmentation may be displayed in the form correspondingto the pigmentation, and the size or state of the pigmentation may berepresented depending on the size or color of the pigmentation.

The analysis result region 4020 may represent the previously analyzedtime-based pigmentation state for each face region (e.g., the rightregion R, the left region L, the top region T or the bottom region B) asthe result of analyzing the pigmentation, using a graph.

According to various embodiments of the present disclosure, if the usermakes a user input (e.g., tap or swipe) as a specific time on the graph,an image used to analyze pigmentation at the time may be displayed inthe image region 4010, and the result of analyzing the pigmentation atthe time may be displayed on the displayed image.

FIG. 41 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 41, if a Manage Changes function (e.g., 3602) isselected in a menu (e.g., 3601) of an application for analyzing faceinformation, an analysis result screen 4100 may display the history ofthe analysis results for various analysis items.

According to various embodiments of the present disclosure, the analysisresult screen 4100 may include an image region 4110 including an imageobtained by analyzing face information at a specific time for a selectedanalysis item, or an analysis result region 4120 including a graphrepresenting the previously analysis results as a score of the skinconditions at the time each analysis item (e.g., pigmentation, troublesor wrinkles) is analyzed.

According to various embodiments of the present disclosure, if the userselects Summary 4131 among analysis items (e.g., Summary, Wrinkle,Trouble, or Pigmentation), an image 4111 analyzed at a first time 4121among the images whose face information is analyzed may be displayed inthe image region 4110. The result of analyzing face information for theimage 4111 may be displayed in the analysis result region 4120, using agraph.

According to various embodiments of the present disclosure, if a userinput 4101 is made as a position corresponding to a specific analysistime of the graph, an image analyzed at the time the user input 4101 ismade may be displayed in the image region 4110. For example, in theimage region 4110, if the user input 4101 is made as a positioncorresponding to a second time 4122, an image 4112 whose faceinformation is analyzed may be displayed at the second time 4122, and ifthe user input 4101 is made as a position corresponding to a third time4123, an image 4113 whose face information is analyzed may be displayedat the third time 4123.

According to various embodiments of the present disclosure, thedisplayed images 4111, 4112 or 4113 are used to analyze face informationat the time (e.g., the first time 4121, the second time 4122 or thethird time 4123) the user input 4101 is made. Since the result ofanalyzing each analysis item at the time is displayed overlapping withthe displayed image, the user may determine the skin conditions for theanalysis item.

FIG. 42 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 42, if a Manage Changes function (e.g., 3602) isselected in a menu (e.g., 3601) of an application for analyzing faceinformation, the history of the analysis results for an analysis item(e.g., Wrinkle 4231) may be displayed on an analysis result screen 4200.For example, the analysis result screen 4200 may include an image region4210 or an analysis result region 4220.

According to various embodiments of the present disclosure, an imagedisplayed in the image region 4210 is an image 4211 whose faceinformation is analyzed at a first time 4221, and the image 4211 may bechanged in size (e.g., zoomed in) in response to a user input (e.g.,pinch in/out). For example, based on the resized image, the user maydetermine the skin conditions in the image that was analyzed at aspecific time 4223.

According to various embodiments of the present disclosure, in the imageregion 4210, setting of the image whose size or position is changed inresponse to a user input may be maintained at other times. For example,if the image is zoomed in as a user input is made on the image 4211,setting of the zoom may be applied even to an image 4212 whose faceinformation is analyzed at a second time 4222. The image 4212 whose faceinformation is analyzed at the second time 4222 may be displayed tocorrespond to a region where the image was zoomed in previously.According to various embodiments of the present disclosure, if a userinput 4201 is made as a position corresponding to a specific analysistime of the graph, an image analyzed at the time the user input 4201 ismade may be displayed in the image region 4110. For example, an image4213 whose face information is analyzed at a third 4223 may be displayedto correspond to a region where the image 4212 was zoomed in previously.

FIG. 43 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 43, if one of various analysis items is selected, ananalysis result screen 4300 may display the analysis results of theselected analysis item in an image region 4310 or an analysis resultregion 4320.

According to various embodiments of the present disclosure, if the userselects Trouble 4331 among analysis items (e.g., Summary, Wrinkle,Trouble, or Pigmentation), an image 4311 whose face information isanalyzed for troubles may be displayed in the image region 4310. Theresult of analyzing the troubles for the image 4311 may be displayed inthe analysis result region 4320, using a graph 4321.

According to various embodiments of the present disclosure, thedisplayed image 4311 is an image used to analyze face information at thetime a user input is made. Since shapes corresponding to the analyzedtroubles are displayed overlapping with the displayed image, the usermay determine the position or conditions of the troubles.

According to various embodiments of the present disclosure, by making auser input (e.g., tap-and-drag) 4301, the user may move the region thathe/she desires to determine in the image, to the image region 4310. Forexample, the result of analyzing the troubles in the image region 4312may be displayed in the analysis result region 4320, using a graph 4322.

According to various embodiments of the present disclosure, as for theimage displayed in the image region 4310, setting of the size orposition displayed in response to a user input may be maintained, andeven if a specific time is selected, the image analyzed at the time maybe displayed according to the setting of the changed size or position.

FIG. 44 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 44, if one (e.g., Trouble 4431) of various analysisitems is selected, an analysis result screen 4400 may display thehistory of face information for the selected analysis item in an imageregion 4410 or an analysis result region 4420.

According to various embodiments of the present disclosure, the imageregion 4410 may be moved or zoomed in a specific image, and the positionwhere the image region 4410 is moved or zoomed in may be maintained,even when an image analyzed at another time is displayed. For example,the user may make a user input (e.g., a touch gesture) in the imageregion 4410, to move the image region 4410 to the region that the userdesires to determine, or to zoom in the region to which the image region4410 is moved.

According to various embodiments of the present disclosure, the user mayselect Trouble 4431 among analysis items, and position or zoom in theposition of the image region 4410 in the left cheek region. In the imageregion 4410, the image analyzed at the earliest time among the imagesanalyzed for Trouble 4431 may be displayed.

According to various embodiments of the present disclosure, as the usermakes a user input 4401 as a first time 4421, a first image 4411analyzed at the first image 4421 may be displayed in the image region4410. For example, in response to the action that the user has moved orzoomed in the image region 4410, the corresponding region in theposition where the image region 4410 is moved or zoomed in, in the firstimage 4411 may be displayed.

According to various embodiments of the present disclosure, if the userinput 4401 is made as a second time 4422, a second image 4412 analyzedat the second time 4422 may be displayed in the image region 4410. Forexample, in response to the action that the user has moved or zoomed inthe image region 4410, the corresponding region in the position wherethe image region 4410 is moved or zoomed in, in the second image 4412may be displayed.

According to various embodiments of the present disclosure, if the userinput 4401 is made as a third time 4423, a third image 4413 analyzed atthe third time 4423 may be displayed in the image region 4410. Forexample, in response to the action that the user has moved or zoomed inthe image region 4410, the corresponding region in the position wherethe image region 4410 is moved or zoomed in, in the third image 4413 maybe displayed.

FIG. 45 illustrates a screen showing a history of analyzed faceinformation according to various embodiments of the present disclosure.

Referring to FIG. 45, if one (e.g., Pigmentation 4531) of variousanalysis items is selected, an analysis result screen 4500 may displaythe history of face information for the selected analysis item in animage region 4510 or an analysis result region 4520.

According to various embodiments of the present disclosure, the imageregion 4510 may be moved or zoomed in a specific image, and the positionwhere the image region 4510 is moved or zoomed in may be maintained,even when an image analyzed at another time is displayed. For example,the user may make a user input (e.g., a touch gesture) in the imageregion 4510, to move the image region 4510 to the region that the userdesires to determine, or to zoom in the region to which the image region4510 is moved.

According to various embodiments of the present disclosure, the user mayselect Pigmentation 4531 among analysis items, and position or zoom inthe position of the image region 4510 in the left cheek region. In theimage region 4510, the image analyzed at the earliest time among theimages analyzed for Pigmentation 4531 may be displayed.

According to various embodiments of the present disclosure, as the usermakes a user input 4501 as a first time 4521, a first image 4511analyzed at the first image 4521 may be displayed in the image region4510. For example, in response to the action that the user has moved orzoomed in the image region 4510, the corresponding region in theposition where the image region 4510 is moved or zoomed in, in the firstimage 4511 may be displayed.

According to various embodiments of the present disclosure, if the userinput 4501 is made as a second time 4522, a second image 4512 analyzedat the second time 4522 may be displayed in the image region 4510. Forexample, in response to the action that the user has moved or zoomed inthe image region 4510, the corresponding region in the position wherethe image region 4510 is moved or zoomed in, in the second image 4512may be displayed.

According to various embodiments of the present disclosure, if the userinput 4501 is made as a third time 4523, a third image 4513 analyzed atthe third time 4523 may be displayed in the image region 4510. Forexample, in response to the action that the user has moved or zoomed inthe image region 4510, the corresponding region in the position wherethe image region 4510 is moved or zoomed in, in the third image 4513 maybe displayed.

FIG. 46 illustrates a shooting operation for a face analysis accordingto various embodiments of the present disclosure.

Referring to FIG. 46, an electronic device may obtain the user's faceimage by enabling the camera module mounted on the front of theelectronic device. For example, the electronic device may obtain theimage at regular intervals in various situations, such as a case wherethe user's face is captured at a specific angle, or a case where theelectronic device is tilted at a specific angle.

According to various embodiments of the present disclosure, while theuser is watching the web browser screen using the electronic device, theelectronic device may run the camera module in the background, making itpossible to capture a user's face image 4600 regardless of the webbrowser screen.

According to various embodiments of the present disclosure, theelectronic device may determine at least one reference point 4601 in thecaptured face image 4600 and identify a face region using the referencepoint, thereby to analyze face information.

FIGS. 47A and 47B illustrate a screen showing results of a skin analysisaccording to various embodiments of the present disclosure.

According to various embodiments of the present disclosure, an analysisresult screen 4700 may be configured in various layouts depending on thesize or rotation direction of the display.

Referring to FIGS. 47A and 47B, if the display is positionedhorizontally or the electronic device is a tablet PC, an image region4710 and an analysis item region 4720 may be horizontally arranged onthe analysis result screen 4700.

According to various embodiments of the present disclosure, if the userselects Pigmentation 4722 in the analysis item region 4720, the resultof analyzing the pigmentation in at least one face region may bedisplayed in the image region 4710 or an analysis result region 4730.

In the image region 4710, as a user input 4701 is made in a specificface region (e.g., the cheek region), the analysis result for the faceregion in which the user input 4701 is made may be zoomed in anddisplayed in a separate window 4712.

According to various embodiments of the present disclosure, as aspecific analysis item is selected in the analysis item region 4720, theanalysis result for the face information may be displayed in theanalysis result region 4730. For example, the analysis result region4730 may include an emoticon 4731 indicating the analysis result for theselected pigmentation, a graph showing the score of each item, or animprovement 4732 of the pigmentation compared with before.

According to various embodiments of the present disclosure, if the userselects Total 4721 in the analysis item region 4720, the result ofanalyzing various analysis items in at least one face region may bedisplayed in the image region 4710 or the analysis result region 4730.

In the image region 4710, at least one face region 4713 analyzedaccording to various analysis items may be displayed, and a legend 4714representing the skin conditions corresponding to the color of each faceregion may be included. For example, the user may determine the skinconditions of a specific part by determining the color of each faceregion.

According to various embodiments of the present disclosure, the analysisresult region 4730 may include a graph 4733 that represents the score bycomparing the analysis results for various analysis items (e.g., pores,wrinkles, pigmentation or troubles) with the previous analysis results.

As is apparent from the foregoing description, an aspect of variousembodiments of the present disclosure may provide an electronic deviceand a method for analyzing face information in the electronic device, inwhich the user may obtain an image, a part of face information of whichis zoomed in or finely captured by the electronic device without anyuser's action, and may determine the analysis results of the obtainedimage.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. A method for analyzing face information in anelectronic device comprising a camera, the method comprising: detectingat least one face region among a plurality of face regions of a face inan image captured by the camera based on at least one reference pointcaptured in the image; identifying the at least one face regioncorresponding to at least one of an oral region, a nasal region, anocular region, a buccal region, or a forehead region based on a zoomingin or a setting of a focus of the camera on the at least one faceregion; identifying, based on the identification of the at least oneface region, at least one analysis item corresponding to theidentification of the at least one face region among a plurality ofanalysis items; measuring at least one skin condition in the at leastone face region, based on the at least one analysis item; obtaininginformation related to skin analysis history corresponding to the atleast one face region based on the measured at least one skin condition;and displaying the information related to the skin analysis history. 2.The method of claim 1, wherein the at least one analysis item comprisesat least one of wrinkles, acne, pigmentation, skin tone, dark circles,or pores.
 3. The method of claim 2, wherein the measuring comprisesanalyzing at least one of thickness, size, number, width, or color foreach of the at least one analysis item in the at least one face region.4. The method of claim 1, further comprising: displaying, upon receivingan input for a specific region in the image, an image obtained byzooming in or setting the focus on the specific region according to theinput.
 5. The method of claim 1, further comprising: detecting the atleast one face region corresponding to the at least one analysis item inthe image; and analyzing the at least one face region according to theat least one analysis item.
 6. The method of claim 1, furthercomprising: displaying, upon detecting the at least one face region inthe image, a screen obtained by zooming in or setting the focus on theat least one face region.
 7. The method of claim 1, further comprising:zooming in or setting the focus on the at least one face region upondetecting an action.
 8. The method of claim 7, wherein the actioncomprises one of executing an application in which the camera isenabled, enabling the electronic device in a locked state, orpositioning the electronic device at a specific angle or in a specificdirection.
 9. The method of claim 1, further comprising: identifying apre-stored analysis result for the at least one face region or the atleast one analysis item; and comparing the pre-stored analysis resultwith a result of the measuring, and displaying a result of thecomparison.
 10. At least one non-transitory computer readable storagemedium storing a computer program of instructions configured to bereadable by at least one processor for instructing the at least oneprocessor to execute a computer process for performing the method ofclaim
 1. 11. An electronic device comprising: a camera; a displayconfigured to display an image that is being captured by the camera; andat least one processor configured to: detect at least one face regionamong a plurality of face regions of a face in the image based on atleast one reference point captured in the image, and control the camerato identify the at least one face region corresponding to at least oneof an oral region, a nasal region, an ocular region, a buccal region, ora forehead region based on a zooming in or a setting of a focus of thecamera on the at least one face region, identify, based on theidentification of the at least one face region, at least one analysisitem corresponding to the identification of the at least one face regionamong a plurality of analysis items, measure at least one skin conditionin the at least one face region based on the at least one analysis item,obtain information related to skin analysis history corresponding to theat least one face region based on the measured at least one skincondition, and display the information related to the skin analysishistory.
 12. The electronic device of claim 11, wherein the at least oneanalysis item comprises at least one of wrinkles, acne, pigmentation,skin tone, dark circles, or pores.
 13. The electronic device of claim12, wherein the at least one processor is further configured to measureat least one of thickness, size, number, width, or color for each of thecorresponding at least one analysis item in the at least one faceregion.
 14. The electronic device of claim 11, wherein the at least oneprocessor is further configured to control the display, upon detectingan input for a specific region in the image, to display an imageobtained by zooming in or setting the focus on the specific regionaccording to the input.
 15. The electronic device of claim 11, whereinthe at least one processor is further configured to: detect the at leastone face region corresponding to the at least one analysis item, andanalyze the at least one face region according to the at least oneanalysis item.
 16. The electronic device of claim 11, wherein the atleast one processor is further configured to control the display, upondetecting the at least one face region in the image, to display a screenfor the at least one face region.
 17. The electronic device of claim 11,wherein the at least one processor is further configured to control thecamera to zoom in or set the focus on the at least one face region upondetecting an action.
 18. The electronic device of claim 17, wherein theaction comprises one of executing an application in which the camera isenabled, enabling the electronic device in a locked state, orpositioning the electronic device at a specific angle or in a specificdirection.
 19. The electronic device of claim 11, wherein the at leastone processor is further configured to: identify a pre-stored analysisresult for the at least one face region or the at least one analysisitem, compare the pre-stored analysis result with a result of themeasuring, and control the display to display a screen including aresult of the comparison.
 20. A method for analyzing face information inan electronic device, the method comprising: detecting at least one faceregion among a plurality of face regions of a face in each of at leastone stored image; identifying the at least one face region correspondingto at least one of an oral region, a nasal region, an ocular region, abuccal region, or a forehead region; identifying, based on theidentification of the at least one face region, at least one analysisitem corresponding to the identification of the at least one face regionamong a plurality of analysis items; and measuring at least one skincondition of the at least one face region based on the at least oneanalysis item; determining analysis times, for each of the at least onestored image, at which the at least one face region had been analyzed;displaying an object representing the analysis times on at least a partof a screen to identify skin analysis history for the at least one faceregion; obtaining an image which is analyzed at a time corresponding toa position on the object selected according to a user input; anddisplaying the obtained image on a part of the screen other than the atleast part of the screen, wherein the obtained image is generated basedon at least one skin condition which is measured at the time as an imagecorresponding to the skin analysis history for the at least one faceregion.
 21. The method of claim 20, further comprising detecting the atleast one face region based on at least one reference point set on theat least one stored image.
 22. The method of claim 20, furthercomprising: determining whether the electronic device is in a situationfor capturing another image; and capturing the other image according tothe determination result, wherein the situation comprises at least oneof: a case where the electronic device is positioned at a predeterminedangle, or a case where a predetermined user input is made.
 23. At leastone non-transitory computer readable storage medium storing a computerprogram of instructions configured to be readable by at least oneprocessor for instructing the at least one processor to execute acomputer process for performing the method of claim
 20. 24. Anelectronic device comprising: a camera configured to capture an image;and at least one processor configured to: detect at least one faceregion among a plurality of face regions of a face in each of at leastone image that is captured by the camera and stored, identify the atleast one face region corresponding to at least one of an oral region, anasal region, an ocular region, a buccal region, or a forehead region,identify, based on the identification of the at least one face region,at least one analysis item corresponding to the identification of the atleast one face region among a plurality of analysis items, and measureat least one skin condition of the at least one face region according tothe at least one analysis item, determine analysis times, for each ofthe at least one image, at which the at least one face region had beenanalyzed, display an object representing the analysis times on at leasta part of a screen to identify skin analysis history for the at leastone face region, obtain an image, of the at least one image, which isanalyzed at a time corresponding to a position on the object selectedaccording to a user input, and display the obtained image on a part ofthe screen other than the at least part of the screen, wherein theobtained image is generated based on at least one skin condition whichis measured at the time as an image corresponding to the skin analysishistory for the at least one face region.
 25. The electronic device ofclaim 24, wherein the at least one processor is further configured todetect the at least one face region based on at least one referencepoint set on the at least one image.
 26. The electronic device of claim24, wherein the at least one processor is further configured to:determine whether the electronic device is in a situation for capturinganother image, and control the camera to capture the other imageaccording to the determination result, and wherein the situationcomprises at least one of: a case where the electronic device ispositioned at a predetermined angle, or a case where a predetermineduser input is made.